2017-01-20T17:09:40.351-0500 [mongosMain] MongoS version 2.6.12 starting: pid=7107 port=4356 64-bit host=its-a51.white.xxx.com (--help for usage) 2017-01-20T17:09:40.351-0500 [mongosMain] db version v2.6.12 2017-01-20T17:09:40.351-0500 [mongosMain] git version: nogitversion 2017-01-20T17:09:40.351-0500 [mongosMain] OpenSSL version: OpenSSL 1.0.1e-fips 11 Feb 2013 2017-01-20T17:09:40.351-0500 [mongosMain] build info: Linux dbsbuild-m04.ops.xxx.com 2.6.32-358.el6.x86_64 #1 SMP Fri Feb 22 00:31:26 UTC 2013 x86_64 BOOST_LIB_VERSION=1_49 2017-01-20T17:09:40.351-0500 [mongosMain] allocator: tcmalloc 2017-01-20T17:09:40.351-0500 [mongosMain] options: { net: { port: 4356 }, processManagement: { fork: true }, security: { keyFile: "/data/servers/mongodb/etc/keyfile" }, sharding: { configDB: "tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307" }, systemLog: { destination: "file", logAppend: true, path: "/data/servers/mongodb/logs/history_mongos.log", quiet: true } } 2017-01-20T17:09:40.391-0500 [mongosMain] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T17:09:40.395-0500 [mongosMain] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T17:09:40.397-0500 [mongosMain] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T17:09:40.429-0500 [mongosMain] creating WriteBackListener for: tconfigdb-m02.db.xxx.com:4307 serverID: 000000000000000000000000 2017-01-20T17:09:40.435-0500 [mongosMain] creating WriteBackListener for: tconfigdb-d01.db.xxx.com:4307 serverID: 000000000000000000000000 2017-01-20T17:09:40.445-0500 [mongosMain] creating WriteBackListener for: tconfigdb-m01.db.xxx.com:4307 serverID: 000000000000000000000000 2017-01-20T17:09:40.576-0500 [mongosMain] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T17:09:40.577-0500 [Balancer] about to contact config servers and shards 2017-01-20T17:09:40.577-0500 [mongosMain] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T17:09:40.577-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T17:09:40.581-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T17:09:40.581-0500 [mongosMain] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T17:09:40.582-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T17:09:40.582-0500 [mongosMain] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T17:09:40.599-0500 [Balancer] starting new replica set monitor for replica set TT-RS01 with seeds tdb-a01.white.xxx.com:4308,tdb-m01.white.xxx.com:4308 2017-01-20T17:09:40.599-0500 [ReplicaSetMonitorWatcher] starting 2017-01-20T17:09:40.602-0500 [mongosMain] waiting for connections on port 4356 2017-01-20T17:09:40.620-0500 [Balancer] starting new replica set monitor for replica set TT-RS02 with seeds tdb-a02.white.xxx.com:4308,tdb-m02.white.xxx.com:4308 2017-01-20T17:09:40.639-0500 [Balancer] starting new replica set monitor for replica set TT-RS03 with seeds tdb-a03.white.xxx.com:4308,tdb-m03.white.xxx.com:4308 2017-01-20T17:09:40.659-0500 [Balancer] starting new replica set monitor for replica set TT-RS04 with seeds tdb-a04.white.xxx.com:4308,tdb-m04.white.xxx.com:4308 2017-01-20T17:09:40.674-0500 [Balancer] starting new replica set monitor for replica set TT-RS05 with seeds tdb-a05.white.xxx.com:4308,tdb-m05.white.xxx.com:4308 2017-01-20T17:09:40.697-0500 [Balancer] starting new replica set monitor for replica set TT-RS06 with seeds tdb-a06.white.xxx.com:4308,tdb-m06.white.xxx.com:4308 2017-01-20T17:09:40.717-0500 [Balancer] starting new replica set monitor for replica set TT-RS07 with seeds tdb-a07.white.xxx.com:4308,tdb-m07.white.xxx.com:4308 2017-01-20T17:09:40.738-0500 [Balancer] starting new replica set monitor for replica set TT-RS08 with seeds tdb-a08.white.xxx.com:4308,tdb-m08.white.xxx.com:4308 2017-01-20T17:09:40.763-0500 [Balancer] starting new replica set monitor for replica set TT-RS09 with seeds tdb-a09.white.xxx.com:4308,tdb-m09.white.xxx.com:4308 2017-01-20T17:09:40.782-0500 [Balancer] starting new replica set monitor for replica set TT-RS10 with seeds tdb-a10.white.xxx.com:4308,tdb-m10.white.xxx.com:4308 2017-01-20T17:09:40.801-0500 [Balancer] starting new replica set monitor for replica set TT-RS11 with seeds tdb-a11.white.xxx.com:4308,tdb-m11.white.xxx.com:4308 2017-01-20T17:09:40.822-0500 [Balancer] starting new replica set monitor for replica set TT-RS12 with seeds tdb-a12.white.xxx.com:4308,tdb-m12.white.xxx.com:4308 2017-01-20T17:09:40.844-0500 [Balancer] starting new replica set monitor for replica set TT-RS13 with seeds tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308 2017-01-20T17:09:40.870-0500 [Balancer] starting new replica set monitor for replica set TT-RS14 with seeds tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308 2017-01-20T17:09:40.894-0500 [Balancer] starting new replica set monitor for replica set TT-RS15 with seeds tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308 2017-01-20T17:09:40.919-0500 [Balancer] starting new replica set monitor for replica set TT-RS16 with seeds tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308 2017-01-20T17:09:40.940-0500 [Balancer] starting new replica set monitor for replica set TT-RS17 with seeds tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308 2017-01-20T17:09:40.959-0500 [Balancer] starting new replica set monitor for replica set TT-RS18 with seeds tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308 2017-01-20T17:09:40.979-0500 [Balancer] starting new replica set monitor for replica set TT-RS19 with seeds tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308 2017-01-20T17:09:40.997-0500 [Balancer] starting new replica set monitor for replica set TT-RS20 with seeds tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308 2017-01-20T17:09:41.174-0500 [Balancer] starting new replica set monitor for replica set TT-RS21 with seeds tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308 2017-01-20T17:09:41.183-0500 [Balancer] starting new replica set monitor for replica set TT-RS22 with seeds tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308 2017-01-20T17:09:41.207-0500 [Balancer] config servers and shards contacted successfully 2017-01-20T17:09:41.207-0500 [Balancer] balancer id: its-a51.white.xxx.com:4356 started at Jan 20 17:09:41 2017-01-20T17:23:22.406-0500 [conn2] ChunkManager: time to load chunks for historyDb.History: 854ms sequenceNumber: 2 version: 3272|39||55c0dbaf5b591f0b0cfcee5f based on: (empty) 2017-01-20T17:23:22.438-0500 [conn2] authenticate db: historyDb { authenticate: 1, user: "its_rw", nonce: "xxx", key: "xxx" } 2017-01-20T17:23:49.884-0500 [conn3] authenticate db: historyDb { authenticate: 1, user: "its_rw", nonce: "xxx", key: "xxx" } 2017-01-20T17:23:49.915-0500 [conn3] creating WriteBackListener for: tdb-a01.white.xxx.com:4308 serverID: 58828aa49527cdec667c0d11 2017-01-20T17:23:49.915-0500 [conn3] creating WriteBackListener for: tdb-m01.white.xxx.com:4308 serverID: 58828aa49527cdec667c0d11 2017-01-20T17:23:49.926-0500 [conn3] creating WriteBackListener for: tdb-a02.white.xxx.com:4308 serverID: 58828aa49527cdec667c0d11 2017-01-20T17:23:49.926-0500 [conn3] creating WriteBackListener for: tdb-m02.white.xxx.com:4308 serverID: 58828aa49527cdec667c0d11 2017-01-20T17:23:49.939-0500 [conn3] creating WriteBackListener for: tdb-a03.white.xxx.com:4308 serverID: 58828aa49527cdec667c0d11 2017-01-20T17:23:49.939-0500 [conn3] creating WriteBackListener for: tdb-m03.white.xxx.com:4308 serverID: 58828aa49527cdec667c0d11 2017-01-20T17:23:49.947-0500 [conn3] creating WriteBackListener for: tdb-a04.white.xxx.com:4308 serverID: 58828aa49527cdec667c0d11 2017-01-20T17:23:49.948-0500 [conn3] creating WriteBackListener for: tdb-m04.white.xxx.com:4308 serverID: 58828aa49527cdec667c0d11 2017-01-20T17:23:49.955-0500 [conn3] creating WriteBackListener for: tdb-a05.white.xxx.com:4308 serverID: 58828aa49527cdec667c0d11 2017-01-20T17:23:49.956-0500 [conn3] creating WriteBackListener for: tdb-m05.white.xxx.com:4308 serverID: 58828aa49527cdec667c0d11 2017-01-20T17:23:49.964-0500 [conn3] creating WriteBackListener for: tdb-a06.white.xxx.com:4308 serverID: 58828aa49527cdec667c0d11 2017-01-20T17:23:49.964-0500 [conn3] creating WriteBackListener for: tdb-m06.white.xxx.com:4308 serverID: 58828aa49527cdec667c0d11 2017-01-20T17:23:49.970-0500 [conn3] creating WriteBackListener for: tdb-a07.white.xxx.com:4308 serverID: 58828aa49527cdec667c0d11 2017-01-20T17:23:49.970-0500 [conn3] creating WriteBackListener for: tdb-m07.white.xxx.com:4308 serverID: 58828aa49527cdec667c0d11 2017-01-20T17:23:49.981-0500 [conn3] creating WriteBackListener for: tdb-a08.white.xxx.com:4308 serverID: 58828aa49527cdec667c0d11 2017-01-20T17:23:49.981-0500 [conn3] creating WriteBackListener for: tdb-m08.white.xxx.com:4308 serverID: 58828aa49527cdec667c0d11 2017-01-20T17:23:49.990-0500 [conn3] creating WriteBackListener for: tdb-a09.white.xxx.com:4308 serverID: 58828aa49527cdec667c0d11 2017-01-20T17:23:49.990-0500 [conn3] creating WriteBackListener for: tdb-m09.white.xxx.com:4308 serverID: 58828aa49527cdec667c0d11 2017-01-20T17:23:49.996-0500 [conn3] creating WriteBackListener for: tdb-a10.white.xxx.com:4308 serverID: 58828aa49527cdec667c0d11 2017-01-20T17:23:49.996-0500 [conn3] creating WriteBackListener for: tdb-m10.white.xxx.com:4308 serverID: 58828aa49527cdec667c0d11 2017-01-20T17:23:50.007-0500 [conn3] creating WriteBackListener for: tdb-a11.white.xxx.com:4308 serverID: 58828aa49527cdec667c0d11 2017-01-20T17:23:50.007-0500 [conn3] creating WriteBackListener for: tdb-m11.white.xxx.com:4308 serverID: 58828aa49527cdec667c0d11 2017-01-20T17:23:50.020-0500 [conn3] creating WriteBackListener for: tdb-a12.white.xxx.com:4308 serverID: 58828aa49527cdec667c0d11 2017-01-20T17:23:50.020-0500 [conn3] creating WriteBackListener for: tdb-m12.white.xxx.com:4308 serverID: 58828aa49527cdec667c0d11 2017-01-20T17:23:50.028-0500 [conn3] creating WriteBackListener for: tdb-a13.white.xxx.com:4308 serverID: 58828aa49527cdec667c0d11 2017-01-20T17:23:50.029-0500 [conn3] creating WriteBackListener for: tdb-m13.white.xxx.com:4308 serverID: 58828aa49527cdec667c0d11 2017-01-20T17:23:50.034-0500 [conn3] creating WriteBackListener for: tdb-a14.white.xxx.com:4308 serverID: 58828aa49527cdec667c0d11 2017-01-20T17:23:50.034-0500 [conn3] creating WriteBackListener for: tdb-m14.white.xxx.com:4308 serverID: 58828aa49527cdec667c0d11 2017-01-20T17:23:50.040-0500 [conn3] creating WriteBackListener for: tdb-a15.white.xxx.com:4308 serverID: 58828aa49527cdec667c0d11 2017-01-20T17:23:50.040-0500 [conn3] creating WriteBackListener for: tdb-m15.white.xxx.com:4308 serverID: 58828aa49527cdec667c0d11 2017-01-20T17:23:50.048-0500 [conn3] creating WriteBackListener for: tdb-a16.white.xxx.com:4308 serverID: 58828aa49527cdec667c0d11 2017-01-20T17:23:50.048-0500 [conn3] creating WriteBackListener for: tdb-m16.white.xxx.com:4308 serverID: 58828aa49527cdec667c0d11 2017-01-20T17:23:50.055-0500 [conn3] creating WriteBackListener for: tdb-a17.white.xxx.com:4308 serverID: 58828aa49527cdec667c0d11 2017-01-20T17:23:50.055-0500 [conn3] creating WriteBackListener for: tdb-m17.white.xxx.com:4308 serverID: 58828aa49527cdec667c0d11 2017-01-20T17:23:50.062-0500 [conn3] creating WriteBackListener for: tdb-a18.white.xxx.com:4308 serverID: 58828aa49527cdec667c0d11 2017-01-20T17:23:50.062-0500 [conn3] creating WriteBackListener for: tdb-m18.white.xxx.com:4308 serverID: 58828aa49527cdec667c0d11 2017-01-20T17:23:50.073-0500 [conn3] creating WriteBackListener for: tdb-a19.white.xxx.com:4308 serverID: 58828aa49527cdec667c0d11 2017-01-20T17:23:50.073-0500 [conn3] creating WriteBackListener for: tdb-m19.white.xxx.com:4308 serverID: 58828aa49527cdec667c0d11 2017-01-20T17:23:50.082-0500 [conn3] creating WriteBackListener for: tdb-a20.white.xxx.com:4308 serverID: 58828aa49527cdec667c0d11 2017-01-20T17:23:50.082-0500 [conn3] creating WriteBackListener for: tdb-m20.white.xxx.com:4308 serverID: 58828aa49527cdec667c0d11 2017-01-20T17:23:50.088-0500 [conn3] creating WriteBackListener for: tdb-a41.white.xxx.com:4308 serverID: 58828aa49527cdec667c0d11 2017-01-20T17:23:50.088-0500 [conn3] creating WriteBackListener for: tdb-m21.white.xxx.com:4308 serverID: 58828aa49527cdec667c0d11 2017-01-20T17:23:50.097-0500 [conn3] creating WriteBackListener for: tdb-a42.white.xxx.com:4308 serverID: 58828aa49527cdec667c0d11 2017-01-20T17:23:50.097-0500 [conn3] creating WriteBackListener for: tdb-m22.white.xxx.com:4308 serverID: 58828aa49527cdec667c0d11 2017-01-20T18:13:41.685-0500 [ReplicaSetMonitorWatcher] Socket recv() timeout 10.74.74.146:4308 2017-01-20T18:13:41.685-0500 [ReplicaSetMonitorWatcher] SocketException: remote: 10.74.74.146:4308 error: 9001 socket exception [RECV_TIMEOUT] server [10.74.74.146:4308] 2017-01-20T18:13:41.685-0500 [ReplicaSetMonitorWatcher] DBClientCursor::init call() failed 2017-01-20T18:13:41.685-0500 [ReplicaSetMonitorWatcher] Detected bad connection created at 1484950180923540 microSec, clearing pool for tdb-m16.white.xxx.com:4308 of 0 connections 2017-01-20T20:31:52.214-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:31:52.218-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:31:52.218-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:31:52.219-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:32:22.223-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:32:22.227-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:32:22.230-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:32:22.248-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:32:22.256-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:32:22.256-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:32:22.256-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:32:52.261-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:32:52.265-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:32:52.267-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:32:52.283-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:32:52.286-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:32:52.286-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:32:52.286-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:33:22.316-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:33:22.320-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:33:22.322-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:33:22.339-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:33:22.342-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:33:22.342-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:33:22.343-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:33:52.359-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:33:52.362-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:33:52.364-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:33:52.379-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:33:52.382-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:33:52.382-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:33:52.382-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:34:22.387-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:34:22.392-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:34:22.395-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:34:22.415-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:34:22.423-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:34:22.423-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:34:22.423-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:34:52.474-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:34:52.478-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:34:52.479-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:34:52.497-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:34:52.501-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:34:52.501-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:34:52.501-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:35:22.505-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:35:22.509-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:35:22.510-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:35:22.529-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:35:22.532-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:35:22.533-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:35:22.533-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:35:52.537-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:35:52.541-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:35:52.544-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:35:52.561-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:35:52.568-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:35:52.568-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:35:52.569-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:36:22.573-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:36:22.577-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:36:22.579-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:36:22.598-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:36:22.606-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:36:22.606-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:36:22.606-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:36:52.611-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:36:52.615-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:36:52.616-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:36:52.636-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:36:52.643-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:36:52.644-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:36:52.644-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:37:22.673-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:37:22.677-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:37:22.679-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:37:22.697-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:37:22.705-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:37:22.705-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:37:22.705-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:37:52.709-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:37:52.713-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:37:52.714-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:37:52.729-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:37:52.732-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:37:52.732-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:37:52.732-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:38:22.745-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:38:22.761-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:38:22.764-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:38:22.785-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:38:22.788-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:38:22.788-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:38:22.788-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:38:52.793-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:38:52.797-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:38:52.799-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:38:52.815-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:38:52.818-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:38:52.819-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:38:52.819-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:39:22.823-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:39:22.827-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:39:22.829-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:39:22.846-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:39:22.849-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:39:22.849-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:39:22.849-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:39:52.854-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:39:52.858-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:39:52.860-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:39:52.880-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:39:52.884-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:39:52.884-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:39:52.884-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:40:22.888-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:40:22.893-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:40:22.896-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:40:22.914-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:40:22.919-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:40:22.919-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:40:22.920-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:40:52.927-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:40:52.931-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:40:52.933-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:40:52.951-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:40:52.955-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:40:52.955-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:40:52.955-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:41:22.959-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:41:22.964-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:41:22.966-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:41:22.983-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:41:22.986-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:41:22.986-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:41:22.986-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:41:53.006-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:41:53.012-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:41:53.013-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:41:53.032-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:41:53.035-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:41:53.035-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:41:53.035-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:42:23.041-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:42:23.045-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:42:23.046-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:42:23.063-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:42:23.067-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:42:23.067-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:42:23.067-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:42:53.078-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:42:53.082-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:42:53.084-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:42:53.103-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:42:53.106-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:42:53.106-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:42:53.106-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:43:23.111-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:43:23.115-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:43:23.117-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:43:23.138-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:43:23.146-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:43:23.146-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:43:23.146-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:43:53.150-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:43:53.154-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:43:53.157-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:43:53.173-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:43:53.181-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:43:53.181-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:43:53.181-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:44:23.185-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:44:23.190-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:44:23.192-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:44:23.207-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:44:23.211-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:44:23.211-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:44:23.211-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:44:53.357-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:44:53.361-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:44:53.363-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:44:53.381-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:44:53.388-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:44:53.388-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:44:53.388-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:45:23.393-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:45:23.397-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:45:23.399-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:45:23.417-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:45:23.424-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:45:23.425-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:45:23.425-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:45:53.429-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:45:53.434-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:45:53.436-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:45:53.452-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:45:53.455-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:45:53.455-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:45:53.455-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:46:23.460-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:46:23.465-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:46:23.467-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:46:23.487-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:46:23.493-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:46:23.494-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:46:23.494-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:46:53.497-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:46:53.501-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:46:53.503-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:46:53.522-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:46:53.529-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:46:53.529-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:46:53.529-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:47:23.534-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:47:23.537-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:47:23.539-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:47:23.556-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:47:23.562-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:47:23.563-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:47:23.563-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:47:53.567-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:47:53.572-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:47:53.574-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:47:53.594-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:47:53.599-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:47:53.599-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:47:53.599-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:48:23.603-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:48:23.606-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:48:23.608-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:48:23.625-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:48:23.632-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:48:23.632-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:48:23.632-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:48:53.640-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:48:53.644-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:48:53.645-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:48:53.663-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:48:53.668-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:48:53.668-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:48:53.668-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:49:23.672-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:49:23.675-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:49:23.677-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:49:23.695-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:49:23.698-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:49:23.698-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:49:23.698-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:49:53.703-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:49:53.707-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:49:53.710-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:49:53.726-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:49:53.729-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:49:53.729-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:49:53.729-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:50:23.733-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:50:23.737-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:50:23.739-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:50:23.756-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:50:23.760-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:50:23.760-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:50:23.761-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:50:53.765-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:50:53.769-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:50:53.770-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:50:53.788-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:50:53.791-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:50:53.791-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:50:53.791-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:51:23.796-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:51:23.800-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:51:23.802-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:51:23.818-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:51:23.821-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:51:23.821-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:51:23.822-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:51:53.828-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:51:53.832-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:51:53.835-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:51:53.851-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:51:53.855-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:51:53.855-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:51:53.855-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:52:23.859-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:52:23.863-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:52:23.865-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:52:23.882-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:52:23.887-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:52:23.887-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:52:23.887-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:52:53.891-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:52:53.895-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:52:53.898-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:52:53.917-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:52:53.924-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:52:53.924-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:52:53.924-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:53:23.936-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:53:23.939-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:53:23.941-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:53:23.957-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:53:23.960-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:53:23.960-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:53:23.961-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:53:53.965-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:53:53.969-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:53:53.971-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:53:53.985-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:53:53.989-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:53:53.989-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:53:53.989-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:54:23.992-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:54:23.997-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:54:23.999-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:54:24.015-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:54:24.019-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:54:24.020-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:54:24.020-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:54:54.084-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:54:54.089-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:54:54.092-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:54:54.111-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:54:54.118-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:54:54.119-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:54:54.119-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:55:24.123-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:55:24.127-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:55:24.130-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:55:24.147-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:55:24.154-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:55:24.155-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:55:24.155-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:55:54.159-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:55:54.163-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:55:54.164-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:55:54.179-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:55:54.186-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:55:54.186-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:55:54.187-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:56:24.191-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:56:24.195-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:56:24.197-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:56:24.214-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:56:24.217-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:56:24.217-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:56:24.217-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:56:54.221-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:56:54.225-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:56:54.227-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:56:54.246-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:56:54.253-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:56:54.253-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:56:54.253-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:57:24.257-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:57:24.262-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:57:24.264-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:57:24.282-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:57:24.286-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:57:24.286-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:57:24.286-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:57:54.290-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:57:54.294-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:57:54.296-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:57:54.312-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:57:54.316-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:57:54.316-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:57:54.316-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:58:24.370-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:58:24.373-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:58:24.375-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:58:24.392-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:58:24.399-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:58:24.399-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:58:24.399-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:58:54.404-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:58:54.408-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:58:54.411-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:58:54.428-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:58:54.436-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:58:54.437-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:58:54.437-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:59:24.441-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:59:24.446-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:59:24.449-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:59:24.467-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:59:24.471-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:59:24.471-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:59:24.471-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T20:59:54.475-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T20:59:54.479-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T20:59:54.482-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T20:59:54.501-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T20:59:54.507-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T20:59:54.507-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T20:59:54.507-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:00:24.511-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:00:24.515-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:00:24.516-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:00:24.535-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:00:24.541-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:00:24.541-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:00:24.541-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:00:54.546-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:00:54.550-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:00:54.551-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:00:54.567-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:00:54.570-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:00:54.570-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:00:54.570-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:01:24.575-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:01:24.579-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:01:24.582-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:01:24.602-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:01:24.609-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:01:24.609-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:01:24.610-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:01:54.614-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:01:54.619-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:01:54.622-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:01:54.638-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:01:54.641-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:01:54.642-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:01:54.642-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:02:24.645-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:02:24.649-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:02:24.651-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:02:24.668-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:02:24.672-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:02:24.672-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:02:24.672-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:02:54.676-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:02:54.680-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:02:54.681-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:02:54.698-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:02:54.702-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:02:54.702-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:02:54.702-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:03:24.706-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:03:24.710-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:03:24.713-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:03:24.731-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:03:24.738-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:03:24.738-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:03:24.738-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:03:54.742-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:03:54.746-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:03:54.749-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:03:54.764-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:03:54.772-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:03:54.772-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:03:54.772-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:04:24.776-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:04:24.779-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:04:24.781-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:04:24.795-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:04:24.799-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:04:24.799-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:04:24.799-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:04:54.890-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:04:54.894-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:04:54.896-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:04:54.913-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:04:54.916-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:04:54.916-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:04:54.916-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:05:24.921-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:05:24.924-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:05:24.926-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:05:24.944-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:05:24.947-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:05:24.947-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:05:24.947-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:05:54.951-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:05:54.955-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:05:54.957-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:05:54.975-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:05:54.982-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:05:54.982-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:05:54.983-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:06:25.059-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:06:25.063-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:06:25.064-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:06:25.082-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:06:25.086-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:06:25.086-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:06:25.086-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:06:55.091-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:06:55.095-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:06:55.098-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:06:55.116-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:06:55.124-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:06:55.124-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:06:55.124-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:07:25.129-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:07:25.132-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:07:25.135-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:07:25.151-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:07:25.155-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:07:25.156-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:07:25.156-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:07:55.160-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:07:55.164-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:07:55.166-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:07:55.186-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:07:55.194-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:07:55.194-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:07:55.194-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:08:25.198-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:08:25.202-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:08:25.204-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:08:25.223-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:08:25.228-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:08:25.228-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:08:25.228-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:08:55.232-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:08:55.236-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:08:55.238-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:08:55.257-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:08:55.262-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:08:55.262-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:08:55.262-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:09:25.266-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:09:25.270-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:09:25.273-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:09:25.290-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:09:25.297-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:09:25.297-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:09:25.297-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:09:55.389-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:09:55.393-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:09:55.395-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:09:55.413-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:09:55.417-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:09:55.417-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:09:55.417-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:10:25.422-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:10:25.426-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:10:25.428-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:10:25.447-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:10:25.455-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:10:25.455-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:10:25.455-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:10:55.465-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:10:55.468-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:10:55.470-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:10:55.486-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:10:55.490-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:10:55.490-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:10:55.490-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:11:25.494-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:11:25.498-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:11:25.501-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:11:25.518-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:11:25.525-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:11:25.526-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:11:25.526-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:11:55.530-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:11:55.535-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:11:55.538-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:11:55.554-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:11:55.559-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:11:55.560-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:11:55.560-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:12:25.564-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:12:25.568-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:12:25.570-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:12:25.589-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:12:25.597-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:12:25.597-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:12:25.597-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:12:55.601-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:12:55.606-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:12:55.608-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:12:55.628-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:12:55.631-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:12:55.632-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:12:55.632-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:13:25.636-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:13:25.640-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:13:25.642-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:13:25.658-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:13:25.661-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:13:25.661-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:13:25.662-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:13:55.667-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:13:55.671-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:13:55.674-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:13:55.691-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:13:55.698-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:13:55.698-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:13:55.698-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:14:25.702-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:14:25.707-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:14:25.709-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:14:25.725-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:14:25.729-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:14:25.729-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:14:25.729-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:14:55.733-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:14:55.737-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:14:55.739-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:14:55.757-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:14:55.764-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:14:55.765-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:14:55.765-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:15:25.796-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:15:25.800-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:15:25.801-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:15:25.819-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:15:25.826-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:15:25.826-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:15:25.826-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:15:55.831-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:15:55.835-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:15:55.837-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:15:55.856-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:15:55.864-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:15:55.864-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:15:55.864-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:16:25.868-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:16:25.872-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:16:25.874-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:16:25.891-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:16:25.894-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:16:25.894-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:16:25.895-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:16:55.903-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:16:55.907-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:16:55.909-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:16:55.929-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:16:55.933-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:16:55.933-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:16:55.933-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:17:25.938-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:17:25.942-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:17:25.944-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:17:25.961-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:17:25.969-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:17:25.969-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:17:25.969-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:17:56.007-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:17:56.011-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:17:56.013-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:17:56.029-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:17:56.037-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:17:56.037-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:17:56.037-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:18:26.041-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:18:26.045-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:18:26.047-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:18:26.063-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:18:26.066-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:18:26.066-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:18:26.066-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:18:56.071-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:18:56.074-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:18:56.076-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:18:56.091-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:18:56.097-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:18:56.097-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:18:56.097-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:19:26.101-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:19:26.106-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:19:26.108-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:19:26.126-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:19:26.133-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:19:26.134-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:19:26.134-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:19:56.138-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:19:56.141-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:19:56.143-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:19:56.162-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:19:56.165-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:19:56.165-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:19:56.165-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:20:26.170-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:20:26.174-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:20:26.177-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:20:26.195-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:20:26.198-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:20:26.198-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:20:26.198-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:20:56.202-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:20:56.206-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:20:56.207-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:20:56.222-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:20:56.226-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:20:56.226-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:20:56.226-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:21:26.230-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:21:26.234-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:21:26.235-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:21:26.254-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:21:26.261-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:21:26.261-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:21:26.261-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:21:56.266-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:21:56.271-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:21:56.273-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:21:56.312-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:21:56.319-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:21:56.319-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:21:56.320-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:22:26.324-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:22:26.328-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:22:26.330-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:22:26.345-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:22:26.349-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:22:26.349-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:22:26.349-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:22:56.353-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:22:56.357-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:22:56.359-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:22:56.378-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:22:56.385-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:22:56.385-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:22:56.385-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:23:26.448-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:23:26.451-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:23:26.453-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:23:26.468-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:23:26.475-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:23:26.475-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:23:26.476-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:23:56.480-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:23:56.484-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:23:56.485-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:23:56.503-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:23:56.507-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:23:56.507-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:23:56.507-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:24:26.511-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:24:26.515-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:24:26.517-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:24:26.535-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:24:26.543-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:24:26.543-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:24:26.543-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:24:56.552-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:24:56.555-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:24:56.557-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:24:56.572-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:24:56.575-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:24:56.575-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:24:56.575-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:25:26.583-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:25:26.587-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:25:26.589-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:25:26.608-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:25:26.613-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:25:26.613-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:25:26.613-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:25:56.617-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:25:56.622-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:25:56.633-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:25:56.653-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:25:56.661-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:25:56.661-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:25:56.661-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:26:26.665-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:26:26.670-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:26:26.672-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:26:26.688-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:26:26.692-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:26:26.692-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:26:26.692-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:26:56.696-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:26:56.701-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:26:56.703-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:26:56.720-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:26:56.724-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:26:56.724-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:26:56.724-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:27:26.731-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:27:26.735-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:27:26.736-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:27:26.752-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:27:26.756-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:27:26.756-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:27:26.756-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:27:56.760-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:27:56.764-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:27:56.766-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:27:56.784-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:27:56.787-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:27:56.787-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:27:56.787-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:28:26.792-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:28:26.796-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:28:26.798-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:28:26.817-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:28:26.821-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:28:26.821-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:28:26.821-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:28:56.826-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:28:56.829-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:28:56.832-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:28:56.849-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:28:56.853-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:28:56.853-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:28:56.854-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:29:26.859-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:29:26.862-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:29:26.864-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:29:26.878-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:29:26.881-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:29:26.881-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:29:26.881-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:29:56.886-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:29:56.891-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:29:56.893-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:29:56.910-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:29:56.914-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:29:56.914-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:29:56.914-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:30:26.920-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:30:26.927-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:30:26.934-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:30:26.956-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:30:26.959-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:30:26.959-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:30:26.959-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:30:56.965-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:30:56.969-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:30:56.971-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:30:56.988-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:30:56.991-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:30:56.991-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:30:56.991-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:31:26.995-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:31:26.999-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:31:27.127-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:31:27.147-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:31:27.150-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:31:27.150-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:31:27.150-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:31:57.154-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:31:57.159-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:31:57.161-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:31:57.179-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:31:57.182-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:31:57.182-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:31:57.182-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:32:27.186-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:32:27.191-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:32:27.193-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:32:27.212-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:32:27.220-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:32:27.220-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:32:27.220-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:32:57.225-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:32:57.229-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:32:57.231-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:32:57.249-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:32:57.255-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:32:57.255-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:32:57.255-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:33:27.259-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:33:27.263-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:33:27.265-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:33:27.281-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:33:27.284-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:33:27.284-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:33:27.284-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:33:57.288-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:33:57.292-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:33:57.293-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:33:57.310-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:33:57.315-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:33:57.315-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:33:57.315-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:34:27.323-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:34:27.332-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:34:27.338-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:34:27.358-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:34:27.362-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:34:27.362-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:34:27.362-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:34:57.366-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:34:57.371-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:34:57.372-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:34:57.408-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:34:57.411-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:34:57.411-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:34:57.411-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:35:27.571-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:35:27.577-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:35:27.579-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:35:27.600-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:35:27.604-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:35:27.604-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:35:27.604-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:35:57.608-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:35:57.612-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:35:57.614-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:35:57.629-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:35:57.632-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:35:57.632-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:35:57.632-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:36:27.636-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:36:27.640-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:36:27.642-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:36:27.659-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:36:27.667-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:36:27.667-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:36:27.667-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:36:57.671-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:36:57.675-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:36:57.678-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:36:57.695-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:36:57.703-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:36:57.703-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:36:57.703-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:37:27.708-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:37:27.713-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:37:27.715-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:37:27.736-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:37:27.743-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:37:27.744-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:37:27.744-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:37:57.748-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:37:57.752-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:37:57.754-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:37:57.772-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:37:57.779-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:37:57.779-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:37:57.779-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:38:27.785-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:38:27.789-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:38:27.790-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:38:27.804-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:38:27.811-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:38:27.811-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:38:27.811-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:38:57.815-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:38:57.819-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:38:57.842-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:38:57.860-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:38:57.864-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:38:57.864-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:38:57.864-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:39:27.890-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:39:27.894-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:39:27.896-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:39:27.911-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:39:27.914-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:39:27.915-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:39:27.915-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:39:57.919-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:39:57.923-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:39:57.926-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:39:57.944-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:39:57.947-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:39:57.947-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:39:57.947-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:40:27.951-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:40:27.955-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:40:27.957-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:40:27.974-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:40:27.978-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:40:27.978-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:40:27.978-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:40:57.982-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:40:57.986-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:40:57.987-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:40:58.003-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:40:58.010-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:40:58.010-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:40:58.010-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:41:28.014-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:41:28.018-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:41:28.020-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:41:28.037-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:41:28.040-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:41:28.040-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:41:28.040-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:41:58.044-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:41:58.049-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:41:58.051-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:41:58.068-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:41:58.073-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:41:58.073-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:41:58.073-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:42:28.077-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:42:28.082-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:42:28.084-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:42:28.103-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:42:28.106-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:42:28.106-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:42:28.106-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:42:58.110-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:42:58.114-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:42:58.116-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:42:58.134-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:42:58.140-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:42:58.140-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:42:58.140-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:43:28.144-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:43:28.148-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:43:28.149-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:43:28.165-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:43:28.168-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:43:28.168-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:43:28.168-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:43:58.189-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:43:58.193-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:43:58.195-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:43:58.213-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:43:58.217-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:43:58.217-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:43:58.218-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:44:28.267-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:44:28.270-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:44:28.272-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:44:28.289-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:44:28.292-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:44:28.292-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:44:28.292-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:44:58.296-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:44:58.300-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:44:58.302-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:44:58.321-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:44:58.324-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:44:58.324-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:44:58.324-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:45:28.329-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:45:28.333-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:45:28.336-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:45:28.354-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:45:28.362-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:45:28.362-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:45:28.362-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:45:58.397-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:45:58.402-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:45:58.404-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:45:58.422-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:45:58.425-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:45:58.425-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:45:58.425-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:46:28.429-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:46:28.433-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:46:28.434-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:46:28.451-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:46:28.454-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:46:28.454-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:46:28.454-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:46:58.458-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:46:58.463-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:46:58.465-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:46:58.484-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:46:58.492-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:46:58.492-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:46:58.492-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:47:28.496-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:47:28.500-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:47:28.503-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:47:28.519-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:47:28.526-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:47:28.526-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:47:28.527-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:47:58.576-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:47:58.581-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:47:58.583-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:47:58.602-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:47:58.606-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:47:58.606-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:47:58.606-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:48:28.610-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:48:28.615-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:48:28.618-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:48:28.639-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:48:28.647-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:48:28.647-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:48:28.647-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:48:58.651-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:48:58.655-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:48:58.657-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:48:58.674-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:48:58.681-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:48:58.682-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:48:58.682-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:49:28.686-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:49:28.689-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:49:28.691-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:49:28.706-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:49:28.710-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:49:28.710-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:49:28.710-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:49:58.793-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:49:58.797-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:49:58.799-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:49:58.815-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:49:58.820-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:49:58.820-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:49:58.820-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:50:28.824-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:50:28.828-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:50:28.831-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:50:28.852-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:50:28.857-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:50:28.857-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:50:28.857-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:50:58.861-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:50:58.866-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:50:58.868-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:50:58.888-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:50:58.895-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:50:58.895-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:50:58.895-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:51:28.899-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:51:28.903-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:51:28.906-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:51:28.923-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:51:28.930-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:51:28.931-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:51:28.931-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:51:58.958-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:51:58.962-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:51:58.964-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:51:58.983-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:51:58.991-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:51:58.991-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:51:58.991-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:52:29.127-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:52:29.133-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:52:29.135-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:52:29.152-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:52:29.156-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:52:29.156-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:52:29.156-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:52:59.160-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:52:59.164-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:52:59.165-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:52:59.180-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:52:59.184-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:52:59.184-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:52:59.184-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:53:29.189-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:53:29.194-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:53:29.196-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:53:29.213-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:53:29.217-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:53:29.217-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:53:29.217-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:53:59.221-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:53:59.226-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:53:59.228-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:53:59.245-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:53:59.249-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:53:59.249-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:53:59.249-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:54:29.253-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:54:29.257-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:54:29.259-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:54:29.277-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:54:29.284-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:54:29.284-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:54:29.284-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:54:59.288-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:54:59.293-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:54:59.295-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:54:59.312-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:54:59.316-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:54:59.316-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:54:59.316-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:55:29.320-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:55:29.326-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:55:29.328-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:55:29.347-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:55:29.354-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:55:29.354-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:55:29.354-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:55:59.359-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:55:59.364-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:55:59.366-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:55:59.386-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:55:59.390-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:55:59.390-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:55:59.390-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:56:29.394-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:56:29.398-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:56:29.399-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:56:29.417-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:56:29.421-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:56:29.421-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:56:29.421-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:56:59.425-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:56:59.429-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:56:59.431-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:56:59.449-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:56:59.456-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:56:59.456-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:56:59.456-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:57:29.461-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:57:29.465-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:57:29.466-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:57:29.483-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:57:29.490-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:57:29.491-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:57:29.491-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:57:59.495-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:57:59.498-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:57:59.500-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:57:59.518-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:57:59.525-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:57:59.525-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:57:59.526-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:58:29.531-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:58:29.535-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:58:29.537-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:58:29.551-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:58:29.555-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:58:29.555-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:58:29.555-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:58:59.559-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:58:59.564-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:58:59.566-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:58:59.585-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:58:59.588-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:58:59.589-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:58:59.589-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:59:29.593-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:59:29.597-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:59:29.600-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:59:29.619-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:59:29.627-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:59:29.627-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:59:29.627-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T21:59:59.654-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T21:59:59.659-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T21:59:59.660-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T21:59:59.677-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T21:59:59.680-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T21:59:59.680-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T21:59:59.681-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:00:29.713-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:00:29.717-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:00:29.719-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:00:29.738-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:00:29.743-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:00:29.744-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:00:29.744-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:00:59.752-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:00:59.756-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:00:59.759-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:00:59.775-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:00:59.783-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:00:59.783-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:00:59.784-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:01:29.788-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:01:29.792-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:01:29.795-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:01:29.812-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:01:29.820-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:01:29.820-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:01:29.821-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:01:59.867-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:01:59.871-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:01:59.874-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:01:59.891-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:01:59.898-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:01:59.898-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:01:59.899-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:02:29.908-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:02:29.913-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:02:29.915-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:02:29.936-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:02:29.944-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:02:29.944-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:02:29.944-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:02:59.950-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:02:59.954-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:02:59.956-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:02:59.974-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:02:59.982-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:02:59.983-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:02:59.983-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:03:29.992-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:03:29.995-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:03:29.997-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:03:30.013-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:03:30.021-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:03:30.021-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:03:30.021-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:04:00.025-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:04:00.030-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:04:00.032-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:04:00.052-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:04:00.058-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:04:00.058-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:04:00.058-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:04:30.062-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:04:30.066-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:04:30.069-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:04:30.089-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:04:30.096-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:04:30.096-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:04:30.096-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:05:00.101-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:05:00.104-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:05:00.107-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:05:00.122-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:05:00.128-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:05:00.129-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:05:00.129-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:05:30.133-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:05:30.137-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:05:30.139-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:05:30.158-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:05:30.161-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:05:30.161-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:05:30.161-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:06:00.165-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:06:00.170-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:06:00.172-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:06:00.192-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:06:00.200-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:06:00.200-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:06:00.200-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:06:30.204-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:06:30.208-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:06:30.211-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:06:30.227-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:06:30.231-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:06:30.231-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:06:30.231-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:07:00.235-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:07:00.240-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:07:00.242-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:07:00.261-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:07:00.268-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:07:00.268-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:07:00.268-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:07:30.276-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:07:30.280-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:07:30.282-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:07:30.298-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:07:30.302-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:07:30.302-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:07:30.302-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:08:00.314-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:08:00.317-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:08:00.319-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:08:00.333-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:08:00.338-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:08:00.338-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:08:00.338-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:08:30.364-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:08:30.368-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:08:30.369-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:08:30.388-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:08:30.391-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:08:30.391-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:08:30.391-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:09:00.396-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:09:00.400-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:09:00.403-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:09:00.418-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:09:00.426-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:09:00.426-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:09:00.426-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:09:30.482-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:09:30.486-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:09:30.487-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:09:30.504-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:09:30.508-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:09:30.508-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:09:30.509-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:10:00.513-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:10:00.518-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:10:00.521-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:10:00.539-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:10:00.545-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:10:00.545-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:10:00.545-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:10:30.558-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:10:30.562-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:10:30.564-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:10:30.583-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:10:30.591-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:10:30.591-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:10:30.591-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:11:00.600-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:11:00.605-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:11:00.607-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:11:00.623-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:11:00.628-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:11:00.628-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:11:00.628-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:11:30.632-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:11:30.637-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:11:30.638-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:11:30.660-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:11:30.667-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:11:30.667-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:11:30.667-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:12:00.672-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:12:00.676-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:12:00.678-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:12:00.697-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:12:00.704-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:12:00.704-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:12:00.704-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:12:30.865-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:12:30.868-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:12:30.871-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:12:30.889-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:12:30.892-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:12:30.892-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:12:30.892-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:13:00.897-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:13:00.900-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:13:00.902-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:13:00.919-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:13:00.924-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:13:00.924-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:13:00.924-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:13:30.928-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:13:30.932-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:13:30.934-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:13:30.951-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:13:30.955-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:13:30.955-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:13:30.955-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:14:00.964-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:14:00.968-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:14:00.970-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:14:00.986-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:14:00.990-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:14:00.990-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:14:00.990-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:14:30.995-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:14:30.999-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:14:31.001-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:14:31.019-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:14:31.022-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:14:31.022-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:14:31.023-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:15:01.066-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:15:01.070-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:15:01.072-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:15:01.088-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:15:01.093-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:15:01.093-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:15:01.094-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:15:31.102-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:15:31.105-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:15:31.107-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:15:31.125-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:15:31.131-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:15:31.131-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:15:31.131-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:16:01.135-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:16:01.139-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:16:01.141-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:16:01.156-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:16:01.161-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:16:01.161-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:16:01.161-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:16:31.166-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:16:31.170-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:16:31.172-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:16:31.189-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:16:31.196-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:16:31.196-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:16:31.196-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:17:01.201-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:17:01.206-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:17:01.241-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:17:01.260-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:17:01.268-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:17:01.268-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:17:01.268-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:17:31.272-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:17:31.276-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:17:31.278-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:17:31.293-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:17:31.300-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:17:31.300-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:17:31.300-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:18:01.305-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:18:01.308-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:18:01.309-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:18:01.325-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:18:01.328-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:18:01.328-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:18:01.328-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:18:31.435-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:18:31.439-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:18:31.441-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:18:31.459-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:18:31.466-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:18:31.466-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:18:31.467-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:19:01.470-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:19:01.474-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:19:01.476-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:19:01.491-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:19:01.495-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:19:01.495-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:19:01.495-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:19:31.499-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:19:31.503-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:19:31.504-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:19:31.519-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:19:31.523-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:19:31.523-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:19:31.523-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:20:01.543-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:20:01.547-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:20:01.548-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:20:01.564-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:20:01.567-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:20:01.567-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:20:01.567-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:20:31.572-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:20:31.576-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:20:31.578-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:20:31.595-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:20:31.598-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:20:31.598-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:20:31.598-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:21:01.605-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:21:01.678-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:21:01.680-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:21:01.695-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:21:01.698-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:21:01.699-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:21:01.699-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:21:31.703-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:21:31.707-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:21:31.709-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:21:31.730-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:21:31.733-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:21:31.733-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:21:31.733-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:22:01.744-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:22:01.748-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:22:01.750-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:22:01.767-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:22:01.771-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:22:01.771-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:22:01.771-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:22:31.777-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:22:31.785-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:22:31.790-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:22:31.805-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:22:31.809-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:22:31.809-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:22:31.809-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:23:01.813-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:23:01.817-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:23:01.819-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:23:01.836-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:23:01.840-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:23:01.840-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:23:01.840-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:23:31.845-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:23:31.849-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:23:31.851-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:23:31.868-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:23:31.872-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:23:31.872-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:23:31.872-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:24:01.877-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:24:01.880-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:24:01.882-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:24:01.899-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:24:01.902-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:24:01.902-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:24:01.902-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:24:31.907-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:24:31.911-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:24:31.913-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:24:31.938-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:24:31.942-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:24:31.942-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:24:31.942-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:25:01.966-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:25:01.970-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:25:01.972-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:25:01.991-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:25:01.994-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:25:01.994-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:25:01.994-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:25:31.999-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:25:32.003-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:25:32.005-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:25:32.025-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:25:32.032-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:25:32.032-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:25:32.033-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:26:02.037-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:26:02.040-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:26:02.042-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:26:02.056-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:26:02.059-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:26:02.059-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:26:02.059-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:26:15.575-0500 [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.72.116.170:4308) 2017-01-20T22:26:15.583-0500 [ReplicaSetMonitorWatcher] warning: No primary detected for set TT-RS07 2017-01-20T22:26:32.064-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:26:32.068-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:26:32.070-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:26:32.087-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:26:32.094-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:26:32.095-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:26:32.095-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:26:40.913-0500 [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.116.170:4308) 2017-01-20T22:26:40.913-0500 [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.116.170:4308) 2017-01-20T22:26:40.914-0500 [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.116.170:4308) 2017-01-20T22:27:02.108-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:27:02.112-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:27:02.115-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:27:02.135-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:27:02.143-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:27:02.143-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:27:02.144-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:27:32.148-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:27:32.151-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:27:32.153-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:27:32.168-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:27:32.172-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:27:32.172-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:27:32.172-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:27:40.915-0500 [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.116.170:4308) 2017-01-20T22:27:40.916-0500 [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.116.170:4308) 2017-01-20T22:28:02.183-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:28:02.186-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:28:02.188-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:28:02.202-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:28:02.206-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:28:02.206-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:28:02.206-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:28:32.214-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:28:32.218-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:28:32.219-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:28:32.236-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:28:32.241-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:28:32.242-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:28:32.242-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:29:02.246-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:29:02.249-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:29:02.251-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:29:02.270-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:29:02.273-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:29:02.273-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:29:02.273-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:29:32.282-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:29:32.286-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:29:32.288-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:29:32.306-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:29:32.310-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:29:32.310-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:29:32.310-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:30:02.366-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:30:02.370-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:30:02.372-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:30:02.390-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:30:02.393-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:30:02.393-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:30:02.393-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:30:32.397-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:30:32.401-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:30:32.403-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:30:32.419-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:30:32.423-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:30:32.423-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:30:32.423-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:31:02.427-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:31:02.431-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:31:02.433-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:31:02.453-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:31:02.456-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:31:02.456-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:31:02.456-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:31:32.460-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:31:32.464-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:31:32.465-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:31:32.481-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:31:32.485-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:31:32.485-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:31:32.485-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:32:02.489-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:32:02.494-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:32:02.496-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:32:02.513-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:32:02.520-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:32:02.521-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:32:02.521-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:32:32.531-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:32:32.537-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:32:32.539-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:32:32.564-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:32:32.571-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:32:32.571-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:32:32.572-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:33:02.576-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:33:02.580-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:33:02.582-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:33:02.603-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:33:02.606-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:33:02.606-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:33:02.606-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:33:32.732-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:33:32.737-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:33:32.738-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:33:32.757-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:33:32.764-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:33:32.764-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:33:32.764-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:34:02.768-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:34:02.772-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:34:02.774-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:34:02.791-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:34:02.795-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:34:02.795-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:34:02.795-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:34:32.805-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:34:32.951-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:34:32.954-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:34:32.974-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:34:32.979-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:34:32.979-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:34:32.979-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:35:02.997-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:35:03.001-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:35:03.002-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:35:03.020-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:35:03.027-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:35:03.027-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:35:03.027-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:35:33.032-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:35:33.036-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:35:33.038-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:35:33.055-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:35:33.059-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:35:33.059-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:35:33.059-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:36:03.064-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:36:03.068-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:36:03.070-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:36:03.089-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:36:03.093-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:36:03.093-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:36:03.093-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:36:33.098-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:36:33.103-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:36:33.105-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:36:33.123-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:36:33.126-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:36:33.126-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:36:33.126-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:37:03.130-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:37:03.134-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:37:03.136-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:37:03.153-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:37:03.157-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:37:03.157-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:37:03.157-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:37:33.161-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:37:33.165-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:37:33.166-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:37:33.185-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:37:33.188-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:37:33.188-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:37:33.188-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:38:03.193-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:38:03.197-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:38:03.199-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:38:03.218-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:38:03.226-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:38:03.226-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:38:03.226-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:38:33.230-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:38:33.234-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:38:33.237-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:38:33.252-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:38:33.256-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:38:33.256-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:38:33.256-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:39:03.260-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:39:03.264-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:39:03.266-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:39:03.284-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:39:03.291-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:39:03.291-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:39:03.291-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:39:33.295-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:39:33.298-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:39:33.300-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:39:33.317-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:39:33.324-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:39:33.324-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:39:33.324-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:40:03.329-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:40:03.332-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:40:03.334-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:40:03.349-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:40:03.353-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:40:03.353-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:40:03.353-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:40:33.357-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:40:33.362-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:40:33.364-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:40:33.382-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:40:33.389-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:40:33.389-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:40:33.389-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:41:03.394-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:41:03.397-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:41:03.399-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:41:03.417-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:41:03.420-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:41:03.420-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:41:03.421-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:41:33.493-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:41:33.497-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:41:33.500-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:41:33.520-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:41:33.525-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:41:33.525-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:41:33.525-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:42:03.530-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:42:03.534-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:42:03.535-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:42:03.553-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:42:03.561-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:42:03.561-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:42:03.561-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:42:33.566-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:42:33.570-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:42:33.571-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:42:33.588-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:42:33.592-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:42:33.592-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:42:33.592-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:43:03.596-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:43:03.600-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:43:03.602-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:43:03.619-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:43:03.623-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:43:03.623-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:43:03.623-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:43:33.627-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:43:33.631-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:43:33.632-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:43:33.651-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:43:33.659-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:43:33.659-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:43:33.659-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:44:03.663-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:44:03.667-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:44:03.669-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:44:03.688-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:44:03.691-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:44:03.691-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:44:03.691-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:44:33.695-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:44:33.700-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:44:33.825-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:44:33.843-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:44:33.850-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:44:33.851-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:44:33.851-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:45:03.855-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:45:03.860-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:45:03.862-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:45:03.879-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:45:03.883-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:45:03.884-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:45:03.884-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:45:33.888-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:45:33.892-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:45:33.894-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:45:33.912-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:45:33.915-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:45:33.915-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:45:33.915-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:46:03.922-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:46:03.926-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:46:03.927-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:46:03.946-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:46:03.949-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:46:03.949-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:46:03.949-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:46:34.006-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:46:34.010-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:46:34.013-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:46:34.029-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:46:34.037-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:46:34.037-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:46:34.037-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:47:04.041-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:47:04.046-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:47:04.048-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:47:04.066-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:47:04.069-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:47:04.070-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:47:04.070-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:47:34.074-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:47:34.078-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:47:34.080-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:47:34.098-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:47:34.102-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:47:34.102-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:47:34.102-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:48:04.107-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:48:04.111-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:48:04.113-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:48:04.128-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:48:04.132-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:48:04.132-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:48:04.132-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:48:34.136-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:48:34.140-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:48:34.142-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:48:34.160-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:48:34.164-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:48:34.164-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:48:34.164-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:49:04.168-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:49:04.173-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:49:04.176-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:49:04.195-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:49:04.203-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:49:04.203-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:49:04.203-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:49:34.211-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:49:34.214-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:49:34.216-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:49:34.233-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:49:34.236-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:49:34.236-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:49:34.236-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:50:04.241-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:50:04.245-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:50:04.247-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:50:04.265-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:50:04.273-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:50:04.273-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:50:04.273-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:50:34.278-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:50:34.281-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:50:34.283-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:50:34.300-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:50:34.305-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:50:34.305-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:50:34.305-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:51:04.310-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:51:04.314-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:51:04.316-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:51:04.338-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:51:04.343-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:51:04.343-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:51:04.343-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:51:34.347-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:51:34.352-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:51:34.354-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:51:34.373-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:51:34.380-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:51:34.381-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:51:34.381-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:52:04.390-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:52:04.395-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:52:04.396-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:52:04.416-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:52:04.422-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:52:04.422-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:52:04.422-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:52:34.423-0500 [Balancer] Socket closed remotely, no longer connected (idle 16 secs, remote host 10.74.137.2:4307) 2017-01-20T22:52:34.423-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:52:34.527-0500 [Balancer] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:52:34.527-0500 [Balancer] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:52:34.527-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:52:34.529-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:52:34.536-0500 [Balancer] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:52:34.540-0500 [Balancer] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:52:34.540-0500 [Balancer] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:52:34.548-0500 [Balancer] Socket closed remotely, no longer connected (idle 30 secs, remote host 10.74.137.2:4307) 2017-01-20T22:52:34.553-0500 [Balancer] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:52:34.564-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:52:34.568-0500 [Balancer] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:52:34.568-0500 [Balancer] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:52:34.569-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:52:34.570-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:52:34.576-0500 [Balancer] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:52:34.580-0500 [Balancer] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:52:34.580-0500 [Balancer] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:52:34.589-0500 [Balancer] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:52:34.593-0500 [Balancer] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:52:34.593-0500 [Balancer] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:52:34.593-0500 [Balancer] query on config.shards: {} failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:52:34.594-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:52:34.602-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:52:34.602-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:52:34.602-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:52:40.943-0500 [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 52 secs, remote host 10.74.137.2:4307) 2017-01-20T22:52:48.444-0500 warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:52:48.444-0500 warning: couldn't check dbhash on config server tconfigdb-m02.db.xxx.com:4307 :: caused by :: 11002 socket exception [CONNECT_ERROR] server [tconfigdb-m02.db.xxx.com:4307] connection pool error: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:52:48.647-0500 [UserCacheInvalidatorThread] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:52:48.652-0500 [UserCacheInvalidatorThread] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:52:48.652-0500 [UserCacheInvalidatorThread] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:52:48.652-0500 [UserCacheInvalidatorThread] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:52:48.654-0500 [UserCacheInvalidatorThread] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:52:48.660-0500 [UserCacheInvalidatorThread] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:52:48.664-0500 [UserCacheInvalidatorThread] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:52:48.664-0500 [UserCacheInvalidatorThread] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:52:48.672-0500 [UserCacheInvalidatorThread] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:52:48.675-0500 [UserCacheInvalidatorThread] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:52:48.675-0500 [UserCacheInvalidatorThread] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:52:48.675-0500 [UserCacheInvalidatorThread] query on admin.$cmd: { _getUserCacheGeneration: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:52:48.680-0500 [UserCacheInvalidatorThread] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:52:48.683-0500 [UserCacheInvalidatorThread] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:52:48.683-0500 [UserCacheInvalidatorThread] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:52:48.683-0500 [UserCacheInvalidatorThread] query on admin.$cmd: { _getUserCacheGeneration: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:52:48.684-0500 [UserCacheInvalidatorThread] User cache generation changed from 58794eb803e8223fde268402 to 58794eb8b7f0be2480e5862f; invalidating user cache 2017-01-20T22:52:54.860-0500 [conn2] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:52:54.865-0500 [conn2] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:52:54.865-0500 [conn2] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:52:54.865-0500 [conn2] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:52:54.867-0500 [conn2] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:52:54.873-0500 [conn2] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:52:54.877-0500 [conn2] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:52:54.877-0500 [conn2] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:52:54.886-0500 [conn2] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:52:54.890-0500 [conn2] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:52:54.890-0500 [conn2] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:52:54.891-0500 [conn2] query on admin.$cmd: { getParameter: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:52:54.895-0500 [conn2] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:52:54.898-0500 [conn2] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:52:54.898-0500 [conn2] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:52:54.899-0500 [conn2] query on admin.$cmd: { getParameter: 1, authSchemaVersion: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:52:54.899-0500 [conn2] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:52:54.902-0500 [conn2] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:52:54.902-0500 [conn2] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:52:54.902-0500 [conn2] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:52:54.904-0500 [conn2] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:52:54.909-0500 [conn2] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:52:54.911-0500 [conn2] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:52:54.911-0500 [conn2] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:52:54.919-0500 [conn2] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:52:54.922-0500 [conn2] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:52:54.922-0500 [conn2] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:52:54.922-0500 [conn2] query on admin.$cmd: { usersInfo: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:52:54.927-0500 [conn2] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:52:54.930-0500 [conn2] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:52:54.930-0500 [conn2] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:52:54.930-0500 [conn2] query on admin.$cmd: { usersInfo: [ { user: "its_rw", db: "historyDb" } ], showPrivileges: true, showCredentials: true } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:53:04.602-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:53:04.607-0500 [Balancer] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:53:04.607-0500 [Balancer] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:53:04.607-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:53:04.657-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:53:04.662-0500 [Balancer] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:53:04.666-0500 [Balancer] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:53:04.666-0500 [Balancer] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:53:04.675-0500 [Balancer] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:53:04.679-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:53:04.682-0500 [Balancer] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:53:04.682-0500 [Balancer] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:53:04.682-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:53:04.684-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:53:04.690-0500 [Balancer] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:53:04.693-0500 [Balancer] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:53:04.693-0500 [Balancer] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:53:04.702-0500 [Balancer] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:53:04.706-0500 [Balancer] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:53:04.706-0500 [Balancer] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:53:04.706-0500 [Balancer] query on config.shards: {} failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:53:04.707-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:53:04.710-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:53:04.710-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:53:04.710-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:53:18.684-0500 [UserCacheInvalidatorThread] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:53:18.688-0500 [UserCacheInvalidatorThread] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:53:18.688-0500 [UserCacheInvalidatorThread] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:53:18.688-0500 [UserCacheInvalidatorThread] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:53:18.690-0500 [UserCacheInvalidatorThread] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:53:18.695-0500 [UserCacheInvalidatorThread] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:53:18.699-0500 [UserCacheInvalidatorThread] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:53:18.699-0500 [UserCacheInvalidatorThread] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:53:18.707-0500 [UserCacheInvalidatorThread] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:53:18.711-0500 [UserCacheInvalidatorThread] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:53:18.711-0500 [UserCacheInvalidatorThread] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:53:18.711-0500 [UserCacheInvalidatorThread] query on admin.$cmd: { _getUserCacheGeneration: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:53:18.716-0500 [UserCacheInvalidatorThread] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:53:18.720-0500 [UserCacheInvalidatorThread] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:53:18.720-0500 [UserCacheInvalidatorThread] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:53:18.720-0500 [UserCacheInvalidatorThread] query on admin.$cmd: { _getUserCacheGeneration: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:53:34.711-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:53:34.715-0500 [Balancer] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:53:34.715-0500 [Balancer] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:53:34.715-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:53:34.717-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:53:34.722-0500 [Balancer] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:53:34.726-0500 [Balancer] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:53:34.726-0500 [Balancer] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:53:34.736-0500 [Balancer] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:53:34.739-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:53:34.742-0500 [Balancer] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:53:34.742-0500 [Balancer] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:53:34.742-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:53:34.744-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:53:34.749-0500 [Balancer] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:53:34.751-0500 [Balancer] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:53:34.751-0500 [Balancer] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:53:34.759-0500 [Balancer] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:53:34.763-0500 [Balancer] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:53:34.763-0500 [Balancer] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:53:34.763-0500 [Balancer] query on config.shards: {} failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:53:34.763-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:53:34.767-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:53:34.767-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:53:34.767-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:53:48.502-0500 warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:53:48.503-0500 warning: couldn't check dbhash on config server tconfigdb-m02.db.xxx.com:4307 :: caused by :: 11002 socket exception [CONNECT_ERROR] server [tconfigdb-m02.db.xxx.com:4307] connection pool error: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:53:48.721-0500 [UserCacheInvalidatorThread] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:53:48.726-0500 [UserCacheInvalidatorThread] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:53:48.726-0500 [UserCacheInvalidatorThread] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:53:48.726-0500 [UserCacheInvalidatorThread] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:53:48.729-0500 [UserCacheInvalidatorThread] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:53:48.735-0500 [UserCacheInvalidatorThread] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:53:48.738-0500 [UserCacheInvalidatorThread] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:53:48.738-0500 [UserCacheInvalidatorThread] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:53:48.748-0500 [UserCacheInvalidatorThread] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:53:48.768-0500 [UserCacheInvalidatorThread] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:53:48.769-0500 [UserCacheInvalidatorThread] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:53:48.769-0500 [UserCacheInvalidatorThread] query on admin.$cmd: { _getUserCacheGeneration: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:53:48.773-0500 [UserCacheInvalidatorThread] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:53:48.777-0500 [UserCacheInvalidatorThread] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:53:48.778-0500 [UserCacheInvalidatorThread] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:53:48.778-0500 [UserCacheInvalidatorThread] query on admin.$cmd: { _getUserCacheGeneration: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:54:04.767-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:54:04.772-0500 [Balancer] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:54:04.772-0500 [Balancer] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:54:04.772-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:54:04.774-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:54:04.780-0500 [Balancer] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:54:04.784-0500 [Balancer] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:54:04.784-0500 [Balancer] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:54:04.817-0500 [Balancer] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:54:04.821-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:54:04.825-0500 [Balancer] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:54:04.825-0500 [Balancer] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:54:04.825-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:54:04.827-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:54:04.832-0500 [Balancer] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:54:04.836-0500 [Balancer] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:54:04.836-0500 [Balancer] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:54:04.844-0500 [Balancer] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:54:04.848-0500 [Balancer] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:54:04.848-0500 [Balancer] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:54:04.848-0500 [Balancer] query on config.shards: {} failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:54:04.850-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:54:04.858-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:54:04.858-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:54:04.858-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:54:18.779-0500 [UserCacheInvalidatorThread] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:54:18.783-0500 [UserCacheInvalidatorThread] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:54:18.783-0500 [UserCacheInvalidatorThread] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:54:18.783-0500 [UserCacheInvalidatorThread] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:54:18.786-0500 [UserCacheInvalidatorThread] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:54:18.792-0500 [UserCacheInvalidatorThread] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:54:18.796-0500 [UserCacheInvalidatorThread] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:54:18.796-0500 [UserCacheInvalidatorThread] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:54:18.804-0500 [UserCacheInvalidatorThread] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:54:18.808-0500 [UserCacheInvalidatorThread] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:54:18.808-0500 [UserCacheInvalidatorThread] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:54:18.808-0500 [UserCacheInvalidatorThread] query on admin.$cmd: { _getUserCacheGeneration: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:54:18.813-0500 [UserCacheInvalidatorThread] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:54:18.817-0500 [UserCacheInvalidatorThread] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:54:18.817-0500 [UserCacheInvalidatorThread] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:54:18.818-0500 [UserCacheInvalidatorThread] query on admin.$cmd: { _getUserCacheGeneration: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:54:34.858-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:54:34.862-0500 [Balancer] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:54:34.862-0500 [Balancer] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:54:34.862-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:54:34.864-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:54:34.868-0500 [Balancer] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:54:34.871-0500 [Balancer] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:54:34.871-0500 [Balancer] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:54:34.880-0500 [Balancer] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:54:34.884-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:54:34.888-0500 [Balancer] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:54:34.888-0500 [Balancer] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:54:34.888-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:54:34.889-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:54:34.894-0500 [Balancer] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:54:34.898-0500 [Balancer] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:54:34.898-0500 [Balancer] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:54:34.907-0500 [Balancer] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:54:34.911-0500 [Balancer] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:54:34.911-0500 [Balancer] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:54:34.911-0500 [Balancer] query on config.shards: {} failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:54:34.912-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:54:34.919-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:54:34.920-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:54:34.920-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:54:48.516-0500 warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:54:48.517-0500 warning: couldn't check dbhash on config server tconfigdb-m02.db.xxx.com:4307 :: caused by :: 11002 socket exception [CONNECT_ERROR] server [tconfigdb-m02.db.xxx.com:4307] connection pool error: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:54:48.818-0500 [UserCacheInvalidatorThread] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:54:48.823-0500 [UserCacheInvalidatorThread] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:54:48.823-0500 [UserCacheInvalidatorThread] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:54:48.823-0500 [UserCacheInvalidatorThread] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:54:48.826-0500 [UserCacheInvalidatorThread] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:54:48.830-0500 [UserCacheInvalidatorThread] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:54:48.834-0500 [UserCacheInvalidatorThread] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:54:48.834-0500 [UserCacheInvalidatorThread] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:54:48.842-0500 [UserCacheInvalidatorThread] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:54:48.846-0500 [UserCacheInvalidatorThread] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:54:48.846-0500 [UserCacheInvalidatorThread] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:54:48.846-0500 [UserCacheInvalidatorThread] query on admin.$cmd: { _getUserCacheGeneration: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:54:48.851-0500 [UserCacheInvalidatorThread] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:54:48.855-0500 [UserCacheInvalidatorThread] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:54:48.855-0500 [UserCacheInvalidatorThread] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:54:48.855-0500 [UserCacheInvalidatorThread] query on admin.$cmd: { _getUserCacheGeneration: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:55:04.920-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:55:04.924-0500 [Balancer] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:55:04.924-0500 [Balancer] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:55:04.924-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:55:04.926-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:55:04.931-0500 [Balancer] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:55:04.935-0500 [Balancer] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:55:04.935-0500 [Balancer] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:55:04.945-0500 [Balancer] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:55:04.949-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:55:04.953-0500 [Balancer] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:55:04.953-0500 [Balancer] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:55:04.954-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:55:04.956-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:55:04.961-0500 [Balancer] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:55:04.964-0500 [Balancer] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:55:04.964-0500 [Balancer] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:55:04.972-0500 [Balancer] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:55:04.975-0500 [Balancer] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:55:04.975-0500 [Balancer] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:55:04.975-0500 [Balancer] query on config.shards: {} failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:55:04.976-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:55:04.979-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:55:04.979-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:55:04.979-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:55:18.856-0500 [UserCacheInvalidatorThread] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:55:18.860-0500 [UserCacheInvalidatorThread] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:55:18.860-0500 [UserCacheInvalidatorThread] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:55:18.860-0500 [UserCacheInvalidatorThread] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:55:18.861-0500 [UserCacheInvalidatorThread] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:55:18.866-0500 [UserCacheInvalidatorThread] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:55:18.869-0500 [UserCacheInvalidatorThread] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:55:18.869-0500 [UserCacheInvalidatorThread] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:55:18.878-0500 [UserCacheInvalidatorThread] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:55:18.881-0500 [UserCacheInvalidatorThread] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:55:18.881-0500 [UserCacheInvalidatorThread] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:55:18.881-0500 [UserCacheInvalidatorThread] query on admin.$cmd: { _getUserCacheGeneration: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:55:18.886-0500 [UserCacheInvalidatorThread] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:55:18.890-0500 [UserCacheInvalidatorThread] warning: Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-01-20T22:55:18.890-0500 [UserCacheInvalidatorThread] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-01-20T22:55:18.890-0500 [UserCacheInvalidatorThread] query on admin.$cmd: { _getUserCacheGeneration: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-01-20T22:55:34.980-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:55:34.983-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:55:34.984-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:55:35.012-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:55:35.015-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:55:35.017-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:55:35.042-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:55:35.046-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:55:35.046-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:55:35.046-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:55:48.896-0500 [UserCacheInvalidatorThread] User cache generation changed from 58794eb8b7f0be2480e5862f to 5882dbb64ee4ff0e5e4be74a; invalidating user cache 2017-01-20T22:56:05.050-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:56:05.053-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:56:05.056-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:56:05.071-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:56:05.080-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:56:05.080-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:56:05.080-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:56:35.084-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:56:35.088-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:56:35.090-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:56:35.105-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:56:35.113-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:56:35.113-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:56:35.113-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:57:05.117-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:57:05.121-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:57:05.123-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:57:05.139-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:57:05.144-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:57:05.145-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:57:05.145-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:57:35.152-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:57:35.157-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:57:35.160-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:57:35.179-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:57:35.187-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:57:35.187-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:57:35.187-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:58:05.191-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:58:05.195-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:58:05.196-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:58:05.214-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:58:05.220-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:58:05.220-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:58:05.220-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:58:35.314-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:58:35.319-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:58:35.321-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:58:35.340-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:58:35.347-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:58:35.347-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:58:35.347-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:59:05.351-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:59:05.355-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:59:05.357-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:59:05.376-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:59:05.380-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:59:05.380-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:59:05.380-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T22:59:35.385-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T22:59:35.389-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T22:59:35.391-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T22:59:35.410-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T22:59:35.418-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T22:59:35.418-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T22:59:35.418-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T23:00:05.422-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T23:00:05.426-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T23:00:05.428-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T23:00:05.446-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T23:00:05.450-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T23:00:05.451-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T23:00:05.451-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T23:00:35.455-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T23:00:35.459-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T23:00:35.460-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T23:00:35.476-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T23:00:35.479-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T23:00:35.479-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T23:00:35.479-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T23:01:05.490-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T23:01:05.494-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T23:01:05.497-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T23:01:05.513-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T23:01:05.516-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T23:01:05.516-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T23:01:05.516-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T23:01:35.527-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T23:01:35.530-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T23:01:35.533-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T23:01:35.565-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T23:01:35.569-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T23:01:35.570-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T23:01:35.570-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T23:02:05.592-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T23:02:05.596-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T23:02:05.597-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T23:02:05.616-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T23:02:05.623-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T23:02:05.623-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T23:02:05.624-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T23:02:35.628-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T23:02:35.632-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T23:02:35.633-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T23:02:35.649-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T23:02:35.652-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T23:02:35.652-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T23:02:35.652-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T23:03:05.656-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T23:03:05.660-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T23:03:05.662-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T23:03:05.676-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T23:03:05.679-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T23:03:05.679-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T23:03:05.680-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T23:03:35.683-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T23:03:35.687-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T23:03:35.688-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T23:03:35.703-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T23:03:35.708-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T23:03:35.708-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T23:03:35.708-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T23:04:05.796-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T23:04:05.800-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T23:04:05.802-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T23:04:05.821-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T23:04:05.829-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T23:04:05.829-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T23:04:05.830-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T23:04:35.874-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T23:04:35.878-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T23:04:35.880-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T23:04:35.900-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T23:04:35.904-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T23:04:35.904-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T23:04:35.904-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T23:05:05.912-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T23:05:05.916-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T23:05:05.918-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T23:05:05.935-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T23:05:05.942-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T23:05:05.942-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T23:05:05.942-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T23:05:35.946-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T23:05:35.951-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T23:05:35.953-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T23:05:35.970-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T23:05:35.973-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T23:05:35.973-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T23:05:35.973-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T23:06:05.977-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T23:06:05.981-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T23:06:05.983-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T23:06:06.003-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T23:06:06.007-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T23:06:06.008-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T23:06:06.008-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T23:06:36.058-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T23:06:36.062-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T23:06:36.064-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T23:06:36.083-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T23:06:36.091-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T23:06:36.091-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T23:06:36.091-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T23:07:06.103-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T23:07:06.106-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T23:07:06.109-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T23:07:06.127-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T23:07:06.131-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T23:07:06.131-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T23:07:06.131-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T23:07:36.135-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T23:07:36.140-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T23:07:36.141-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T23:07:36.160-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T23:07:36.164-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T23:07:36.164-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T23:07:36.164-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T23:08:06.168-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T23:08:06.176-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T23:08:06.179-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T23:08:06.197-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T23:08:06.200-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T23:08:06.200-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T23:08:06.201-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T23:08:36.205-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T23:08:36.209-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T23:08:36.211-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T23:08:36.230-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T23:08:36.234-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T23:08:36.234-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T23:08:36.235-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T23:09:06.242-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T23:09:06.253-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T23:09:06.258-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T23:09:06.278-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T23:09:06.282-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T23:09:06.282-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T23:09:06.282-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T23:09:36.294-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T23:09:36.298-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T23:09:36.299-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T23:09:36.318-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T23:09:36.324-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T23:09:36.324-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T23:09:36.324-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T23:10:06.329-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T23:10:06.332-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T23:10:06.334-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T23:10:06.350-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T23:10:06.353-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T23:10:06.353-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T23:10:06.353-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T23:10:36.357-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T23:10:36.361-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T23:10:36.362-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T23:10:36.381-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T23:10:36.388-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T23:10:36.389-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T23:10:36.389-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T23:11:06.393-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T23:11:06.397-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T23:11:06.400-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T23:11:06.416-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T23:11:06.423-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T23:11:06.423-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T23:11:06.423-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T23:11:36.428-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T23:11:36.431-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T23:11:36.433-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T23:11:36.452-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T23:11:36.456-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T23:11:36.456-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T23:11:36.456-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T23:12:06.461-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T23:12:06.466-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T23:12:06.467-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T23:12:06.483-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T23:12:06.486-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T23:12:06.486-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T23:12:06.486-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T23:12:36.490-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T23:12:36.494-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T23:12:36.496-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T23:12:36.513-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T23:12:36.520-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T23:12:36.520-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T23:12:36.521-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T23:13:06.525-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T23:13:06.530-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T23:13:06.534-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T23:13:06.560-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T23:13:06.565-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T23:13:06.565-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T23:13:06.565-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T23:13:36.576-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T23:13:36.580-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T23:13:36.582-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T23:13:36.602-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T23:13:36.605-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T23:13:36.605-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T23:13:36.605-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T23:14:06.610-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T23:14:06.616-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T23:14:06.618-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T23:14:06.635-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T23:14:06.638-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T23:14:06.638-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T23:14:06.638-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T23:14:36.642-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T23:14:36.646-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T23:14:36.648-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T23:14:36.666-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T23:14:36.671-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T23:14:36.672-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T23:14:36.672-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T23:15:06.684-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T23:15:06.689-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T23:15:06.691-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T23:15:06.710-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T23:15:06.715-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T23:15:06.715-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T23:15:06.715-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T23:15:36.723-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T23:15:36.731-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T23:15:36.737-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-20T23:15:36.755-0500 [Balancer] Assertion: 13110:HostAndPort: host is empty 2017-01-20T23:15:36.761-0500 [Balancer] 0xb17956 0xad1d58 0xab8e6b 0x73fe63 0x73e978 0xa29a3a 0xa2e164 0x96df19 0xabb355 0xb60be4 0x3326607aa1 0x33262e8aad /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15printStackTraceERSo+0x26) [0xb17956] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo10logContextEPKc+0x188) [0xad1d58] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11msgassertedEiPKc+0xcb) [0xab8e6b] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo11HostAndPortC1ERKSs+0xe3) [0x73fe63] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo16ConnectionString12_fillServersESs+0x2b8) [0x73e978] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo5Shard8_setAddrERKSs+0x9a) [0xa29a3a] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo15StaticShardInfo6reloadEv+0x594) [0xa2e164] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo8Balancer3runEv+0x539) [0x96df19] /opt/local/pkg/mongodb-server-ssl/bin/mongos(_ZN5mongo13BackgroundJob7jobBodyEv+0x105) [0xabb355] /opt/local/pkg/mongodb-server-ssl/bin/mongos() [0xb60be4] /lib64/libpthread.so.0() [0x3326607aa1] /lib64/libc.so.6(clone+0x6d) [0x33262e8aad] 2017-01-20T23:15:36.761-0500 [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-01-20T23:15:36.761-0500 [Balancer] caught exception while doing balance: HostAndPort: host is empty 2017-01-20T23:15:49.016-0500 warning: config servers tconfigdb-m02.db.xxx.com:4307 and tconfigdb-d01.db.xxx.com:4307 differ 2017-01-20T23:15:49.022-0500 warning: config servers tconfigdb-m02.db.xxx.com:4307 and tconfigdb-d01.db.xxx.com:4307 differ 2017-01-20T23:15:49.028-0500 warning: config servers tconfigdb-m02.db.xxx.com:4307 and tconfigdb-d01.db.xxx.com:4307 differ 2017-01-20T23:15:49.039-0500 warning: config servers tconfigdb-m02.db.xxx.com:4307 and tconfigdb-d01.db.xxx.com:4307 differ 2017-01-20T23:15:49.039-0500 ERROR: could not verify that config servers are in sync :: caused by :: config servers tconfigdb-m02.db.xxx.com:4307 and tconfigdb-d01.db.xxx.com:4307 differ: { chunks: "87ce0a759d4128997aa4ac020cbc455d", collections: "160aa34386cbca094354ab5b8a10a4fc", databases: "cf68151810fa6f6ed55aac1e61d9be86", shards: "ce6c779224af89e73efdf044c7a9f3ef", version: "dc4ceee40af77d8d78dcea8dabed01bf" } vs { chunks: "87ce0a759d4128997aa4ac020cbc455d", collections: "160aa34386cbca094354ab5b8a10a4fc", databases: "cf68151810fa6f6ed55aac1e61d9be86", shards: "4d228dce0d8f988b0b25f2c0566c65d5", version: "dc4ceee40af77d8d78dcea8dabed01bf" } 2017-01-20T23:16:06.765-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-20T23:16:06.768-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-20T23:16:06.770-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-21T00:00:09.061-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-21T00:00:09.062-0500 [LockPinger] creating distributed lock ping thread for tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 and process its-a51.white.xxx.com:4356:1484950181:1804289383 (sleeping for 30000ms) 2017-01-21T00:00:09.066-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-21T00:00:09.067-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-21T00:00:09.250-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:00:09.250-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:00:09.355-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:00:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:00:39.543-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-21T00:00:39.549-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-21T00:00:39.551-0500 [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-21T00:00:39.802-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:00:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:01:10.047-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:01:10.047-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:01:10.150-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:01:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:01:40.415-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:01:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:02:04.990-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:02:04.990-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:02:10.685-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:02:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:02:17.451-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:02:17.452-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:02:29.700-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:02:29.700-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:02:36.040-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882eb6b9527cdec667c0d1a 2017-01-21T00:02:36.671-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T00:02:41.012-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:02:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:02:43.123-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882eb729527cdec667c0d1b 2017-01-21T00:02:43.728-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T00:03:02.207-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882eb859527cdec667c0d1c 2017-01-21T00:03:02.728-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T00:03:11.278-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:03:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:03:41.540-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:03:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:03:51.434-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:03:51.434-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:03:57.730-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:03:57.730-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:04:11.716-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:04:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:04:16.223-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882ebcf9527cdec667c0d1f 2017-01-21T00:04:16.782-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T00:04:41.988-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:04:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:05:12.170-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:05:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:05:17.716-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:05:17.716-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:05:30.025-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:05:30.025-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:05:42.452-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:05:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:05:48.305-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:05:48.305-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:06:06.661-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5882ec3db081817bb2461a40') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1484975166566), why: "doing balance round", ts: ObjectId('5882ec3e9527cdec667c0d23') } } gle1: { lastOp: Timestamp 1484975166000|22, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 6, writtenTo: null, err: null, waited: 6, ok: 1.0 } gle2: { lastOp: Timestamp 1484975056000|17, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 15, writtenTo: null, err: null, waited: 15, ok: 1.0 } 2017-01-21T00:06:06.667-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-21T00:06:06.668-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:06:12.649-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:06:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:06:12.650-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-21T00:06:12.724-0500 [LockPinger] handled late remove of old distributed lock with ts 5882ec3e9527cdec667c0d23 2017-01-21T00:06:25.010-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:06:25.010-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:06:43.150-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:06:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:07:13.449-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:07:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:07:43.721-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:07:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:08:08.230-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:08:08.230-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:08:14.046-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:08:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:08:44.355-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:08:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:09:14.733-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:09:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:09:15.022-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:09:15.023-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:09:27.305-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:09:27.305-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:09:45.021-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:09:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:09:45.660-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:09:45.660-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:09:58.222-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882ed259527cdec667c0d29 2017-01-21T00:09:58.911-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T00:10:15.407-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:10:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:10:23.317-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:10:23.318-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:10:35.667-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:10:35.667-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:10:41.856-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5882ed50b3cf2809cb1619d1') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1484975441727), why: "doing balance round", ts: ObjectId('5882ed519527cdec667c0d2c') } } gle1: { lastOp: Timestamp 1484975441000|32, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 2, writtenTo: null, err: null, waited: 2, ok: 1.0 } gle2: { lastOp: Timestamp 1484975398000|29, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 24, writtenTo: null, err: null, waited: 24, ok: 1.0 } 2017-01-21T00:10:41.861-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-21T00:10:41.861-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:10:45.713-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:10:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:10:45.713-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-21T00:10:45.854-0500 [LockPinger] handled late remove of old distributed lock with ts 5882ed519527cdec667c0d2c 2017-01-21T00:11:06.215-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:11:06.215-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:11:16.130-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:11:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:11:46.540-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:11:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:12:16.828-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:12:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:12:31.425-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882edbf9527cdec667c0d2e 2017-01-21T00:12:32.059-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T00:12:47.084-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:12:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:13:17.411-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:13:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:13:47.686-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:13:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:14:17.967-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:14:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:14:21.325-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:14:21.326-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:14:45.722-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:14:45.722-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:14:48.265-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:14:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:15:18.693-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:15:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:15:46.562-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5882ee81b081817bb2461a50') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1484975746475), why: "doing balance round", ts: ObjectId('5882ee829527cdec667c0d31') } } gle1: { lastOp: Timestamp 1484975746000|31, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 3, writtenTo: null, err: null, waited: 3, ok: 1.0 } gle2: { lastOp: Timestamp 1484975552000|2, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 17, writtenTo: null, err: null, waited: 17, ok: 1.0 } 2017-01-21T00:15:46.571-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-21T00:15:46.712-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882ee829527cdec667c0d31 2017-01-21T00:15:47.356-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T00:15:49.088-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:15:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:16:05.833-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882ee959527cdec667c0d32 2017-01-21T00:16:06.455-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T00:16:19.373-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:16:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:16:24.982-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:16:24.983-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:16:49.614-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882eec19527cdec667c0d34 2017-01-21T00:16:49.646-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:16:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:16:50.212-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T00:17:19.918-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:17:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:17:44.979-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:17:44.979-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:17:50.084-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:17:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:18:03.313-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:18:03.313-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:18:20.363-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:18:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:18:50.654-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:18:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:19:10.497-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882ef4e9527cdec667c0d37 2017-01-21T00:19:11.093-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T00:19:20.993-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:19:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:19:29.630-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882ef619527cdec667c0d38 2017-01-21T00:19:30.263-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T00:19:51.226-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:19:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:20:21.488-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:20:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:20:43.297-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:20:43.297-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:20:51.901-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:20:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:21:07.677-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:21:07.677-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:21:19.962-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:21:19.962-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:21:22.158-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:21:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:21:50.469-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:21:50.469-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:21:52.419-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:21:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:22:22.872-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:22:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:22:33.015-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:22:33.015-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:22:53.233-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:22:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:22:57.447-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:22:57.447-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:23:23.465-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:23:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:23:46.165-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:23:46.165-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:23:52.366-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:23:52.366-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:23:53.606-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:23:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:24:23.913-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:24:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:24:34.956-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:24:34.956-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:24:54.194-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:24:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:25:24.632-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:25:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:25:54.019-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:25:54.019-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:25:54.936-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:25:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:26:06.244-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:26:06.245-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:26:25.234-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:26:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:26:42.969-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:26:42.969-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:26:55.535-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:26:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:27:01.444-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882f1259527cdec667c0d45 2017-01-21T00:27:02.040-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T00:27:20.532-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882f1389527cdec667c0d46 2017-01-21T00:27:21.170-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T00:27:25.905-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:27:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:27:56.175-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:27:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:28:03.975-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:28:03.975-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:28:10.143-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:28:10.144-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:28:26.441-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:28:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:28:40.739-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:28:40.739-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:28:56.800-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:28:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:29:17.302-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:29:17.302-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:29:27.077-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:29:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:29:41.853-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:29:41.853-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:29:57.374-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:29:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:30:27.523-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:30:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:30:57.811-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:30:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:31:28.162-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:31:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:31:58.438-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:31:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:32:07.630-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:32:07.630-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:32:19.977-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:32:19.977-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:32:28.716-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:32:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:32:59.001-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:32:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:33:20.833-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882f2a09527cdec667c0d4e 2017-01-21T00:33:21.469-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T00:33:29.361-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:33:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:33:58.274-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882f2c59527cdec667c0d4f 2017-01-21T00:33:58.934-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T00:33:59.740-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:33:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:34:17.474-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882f2d99527cdec667c0d50 2017-01-21T00:34:18.175-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T00:34:30.120-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:34:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:34:36.618-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:34:36.618-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:34:42.919-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882f2f29527cdec667c0d52 2017-01-21T00:34:43.516-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T00:34:49.945-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882f2f99527cdec667c0d53 2017-01-21T00:34:50.580-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T00:35:00.434-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:35:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:35:30.722-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:35:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:36:00.954-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:36:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:36:31.113-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:36:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:37:01.475-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:37:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:37:16.504-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882f38c9527cdec667c0d54 2017-01-21T00:37:17.077-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T00:37:23.405-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882f3939527cdec667c0d55 2017-01-21T00:37:24.179-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T00:37:31.625-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:37:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:38:00.791-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:38:00.791-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:38:01.889-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:38:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:38:32.172-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:38:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:39:02.376-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:39:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:39:32.697-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:39:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:39:44.251-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882f41f9527cdec667c0d57 2017-01-21T00:39:44.990-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T00:40:03.048-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:40:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:40:33.330-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:40:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:40:33.985-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882f4519527cdec667c0d58 2017-01-21T00:40:34.543-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T00:40:41.063-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882f4589527cdec667c0d59 2017-01-21T00:40:41.696-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T00:41:03.618-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:41:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:41:18.335-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882f47e9527cdec667c0d5a 2017-01-21T00:41:18.863-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T00:41:33.833-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:41:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:41:49.420-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:41:49.420-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:42:04.108-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:42:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:42:34.287-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:42:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:43:04.474-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:43:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:43:34.671-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:43:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:44:04.931-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:44:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:44:15.129-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:44:15.130-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:44:21.331-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:44:21.331-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:44:35.192-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:44:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:44:39.912-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:44:39.912-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:45:05.576-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:45:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:45:10.377-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:45:10.377-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:45:35.786-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:45:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:45:53.032-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:45:53.032-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:46:06.089-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:46:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:46:35.743-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:46:35.743-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:46:36.342-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:46:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:47:06.685-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:47:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:47:24.520-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:47:24.520-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:47:30.725-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:47:30.725-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:47:36.875-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:47:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:47:42.955-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5882f5feaa6da0fe8d55a16b') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1484977662846), why: "doing balance round", ts: ObjectId('5882f5fe9527cdec667c0d64') } } gle1: { lastOp: Timestamp 1484977662000|69, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 12, writtenTo: null, err: null, waited: 12, ok: 1.0 } gle2: { lastOp: Timestamp 1484977278000|33, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 2, writtenTo: null, err: null, waited: 2, ok: 1.0 } 2017-01-21T00:47:42.965-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-21T00:47:43.066-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882f5fe9527cdec667c0d64 2017-01-21T00:47:43.736-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T00:48:07.145-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:48:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:48:37.381-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:48:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:49:07.669-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:49:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:49:15.004-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882f65a9527cdec667c0d65 2017-01-21T00:49:15.713-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T00:49:22.049-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882f6619527cdec667c0d66 2017-01-21T00:49:22.755-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T00:49:29.205-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882f6689527cdec667c0d67 2017-01-21T00:49:29.911-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T00:49:37.958-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:49:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:49:42.148-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:49:42.148-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:50:00.567-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882f6889527cdec667c0d69 2017-01-21T00:50:01.091-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T00:50:08.342-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:50:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:50:38.693-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:50:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:51:08.991-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:51:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:51:26.468-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882f6de9527cdec667c0d6a 2017-01-21T00:51:27.097-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T00:51:39.217-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:51:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:51:57.700-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882f6fd9527cdec667c0d6b 2017-01-21T00:51:58.407-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T00:52:04.756-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882f7049527cdec667c0d6c 2017-01-21T00:52:05.320-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T00:52:09.483-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:52:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:52:39.628-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:52:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:53:09.812-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:53:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:53:24.415-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:53:24.415-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:53:40.078-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:53:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:53:43.049-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882f7669527cdec667c0d6e 2017-01-21T00:53:43.679-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T00:53:56.110-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882f7739527cdec667c0d6f 2017-01-21T00:53:56.745-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T00:54:03.021-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882f77a9527cdec667c0d70 2017-01-21T00:54:03.635-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T00:54:10.362-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:54:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:54:40.656-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:54:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:55:10.971-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:55:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:55:41.238-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:55:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:56:11.522-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:56:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:56:35.737-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:56:35.737-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:56:41.766-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:56:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:57:12.037-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:57:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:57:42.284-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:57:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:58:12.572-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:58:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:58:25.286-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882f8819527cdec667c0d72 2017-01-21T00:58:25.917-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T00:58:32.116-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:58:32.116-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:58:38.487-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882f88e9527cdec667c0d74 2017-01-21T00:58:39.188-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T00:58:42.868-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:58:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:59:13.116-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:59:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:59:15.835-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:59:15.835-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T00:59:43.504-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 00:59:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T00:59:58.582-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T00:59:58.583-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:00:13.912-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:00:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:00:23.004-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:00:23.004-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:00:44.182-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:00:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:01:14.540-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:01:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:01:44.824-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:01:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:02:06.216-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:02:06.216-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:02:15.247-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:02:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:02:18.506-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:02:18.506-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:02:30.789-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:02:30.789-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:02:45.528-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:02:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:02:55.171-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:02:55.171-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:03:15.811-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:03:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:03:25.738-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:03:25.738-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:03:44.170-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:03:44.170-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:03:46.140-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:03:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:04:16.344-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:04:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:04:44.934-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:04:44.934-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:04:46.653-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:04:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:05:16.791-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:05:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:05:46.067-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882fa399527cdec667c0d7f 2017-01-21T01:05:46.715-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T01:05:47.092-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:05:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:06:17.276-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:06:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:06:29.480-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:06:29.480-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:06:47.551-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:06:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:06:47.945-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882fa779527cdec667c0d81 2017-01-21T01:06:48.546-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T01:07:17.828-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:07:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:07:43.542-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882faaf9527cdec667c0d82 2017-01-21T01:07:44.212-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T01:07:48.034-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:07:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:07:56.657-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882fabc9527cdec667c0d83 2017-01-21T01:07:57.302-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T01:08:09.579-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:08:09.579-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:08:15.807-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:08:15.807-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:08:18.254-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:08:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:08:48.455-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:08:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:09:18.713-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:09:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:09:22.762-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:09:22.762-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:09:49.013-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:09:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:10:19.300-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:10:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:10:49.629-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:10:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:11:19.936-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:11:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:11:50.168-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:11:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:12:19.006-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:12:19.007-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:12:20.411-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:12:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:12:50.744-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:12:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:13:19.988-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:13:19.989-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:13:21.046-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:13:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:13:26.333-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882fc069527cdec667c0d89 2017-01-21T01:13:26.977-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T01:13:33.328-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882fc0d9527cdec667c0d8a 2017-01-21T01:13:33.957-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T01:13:46.373-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882fc1a9527cdec667c0d8b 2017-01-21T01:13:46.998-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T01:13:51.324-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:13:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:14:21.465-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:14:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:14:51.744-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:14:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:15:22.063-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:15:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:15:24.281-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:15:24.281-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:15:30.443-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:15:30.443-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:15:52.261-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:15:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:16:06.917-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:16:06.917-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:16:22.471-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:16:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:16:31.519-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882fcbf9527cdec667c0d8f 2017-01-21T01:16:32.187-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T01:16:38.414-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882fcc69527cdec667c0d90 2017-01-21T01:16:39.007-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T01:16:52.765-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:16:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:17:23.032-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:17:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:17:33.701-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:17:33.701-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:17:53.289-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:17:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:18:22.565-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:18:22.565-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:18:23.519-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:18:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:18:53.806-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:18:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:19:23.990-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:19:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:19:41.898-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:19:41.899-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:19:54.129-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:19:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:20:18.498-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:20:18.498-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:20:24.433-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:20:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:20:54.637-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:20:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:21:24.784-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:21:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:21:49.698-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:21:49.698-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:21:55.074-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:21:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:21:55.925-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:21:55.925-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:22:25.355-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:22:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:22:26.354-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:22:26.354-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:22:55.677-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:22:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:23:26.002-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:23:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:23:56.290-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:23:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:24:26.647-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:24:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:24:33.972-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:24:33.972-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:24:56.915-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:24:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:25:27.223-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:25:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:25:46.903-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:25:46.903-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:25:53.114-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:25:53.114-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:25:57.502-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:25:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:26:27.651-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:26:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:26:35.676-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:26:35.676-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:26:41.837-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:26:41.837-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:26:57.912-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:26:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:27:28.288-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:27:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:27:58.514-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:27:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:28:13.011-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:28:13.011-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:28:28.712-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:28:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:28:43.697-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882ff9b9527cdec667c0d9e 2017-01-21T01:28:44.502-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T01:28:50.762-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882ffa29527cdec667c0d9f 2017-01-21T01:28:51.392-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T01:28:58.988-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:28:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:29:09.867-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5882ffb59527cdec667c0da0 2017-01-21T01:29:10.537-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T01:29:16.862-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:29:16.862-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:29:29.243-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:29:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:29:41.200-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:29:41.200-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:29:59.518-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:29:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:30:29.809-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:30:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:31:00.418-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:30:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:31:12.383-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:31:12.383-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:31:24.695-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:31:24.695-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:31:30.692-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:31:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:31:49.119-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:31:49.119-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:32:01.042-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:32:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:32:31.329-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:32:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:32:37.815-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:32:37.815-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:32:56.174-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:32:56.174-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:33:01.646-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:33:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:33:14.690-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:33:14.691-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:33:26.986-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:33:26.987-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:33:31.899-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:33:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:34:02.174-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:34:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:34:15.671-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:34:15.671-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:34:21.873-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588300eca02d991708a9e753') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1484980461727), why: "doing balance round", ts: ObjectId('588300ed9527cdec667c0dab') } } gle1: { lastOp: Timestamp 1484980461000|30, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 2, writtenTo: null, err: null, waited: 2, ok: 1.0 } gle2: { lastOp: Timestamp 1484980150000|23, connectionId: 393608, updatedExisting: false, n: 0, syncMillis: 35, writtenTo: null, err: null, waited: 35, ok: 1.0 } 2017-01-21T01:34:21.882-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-21T01:34:22.054-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588300ed9527cdec667c0dab 2017-01-21T01:34:22.625-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T01:34:32.335-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:34:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:35:02.501-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:35:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:35:11.292-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5883011f9527cdec667c0dac 2017-01-21T01:35:11.879-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T01:35:24.146-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5883012c9527cdec667c0dad 2017-01-21T01:35:24.810-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T01:35:32.821-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:35:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:36:03.011-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:36:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:36:19.706-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588301639527cdec667c0dae 2017-01-21T01:36:20.361-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T01:36:33.279-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:36:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:36:38.726-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:36:38.726-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:37:03.210-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:37:03.210-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:37:03.672-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:37:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:37:33.797-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:37:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:37:39.660-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:37:39.660-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:38:04.110-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:38:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:38:28.312-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:38:28.312-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:38:34.398-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:38:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:38:34.508-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:38:34.508-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:38:46.769-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:38:46.769-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:38:59.088-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:38:59.088-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:39:04.708-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:39:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:39:05.307-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:39:05.307-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:39:11.595-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:39:11.595-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:39:34.907-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:39:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:39:35.973-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:39:35.973-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:40:05.257-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:40:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:40:12.709-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:40:12.709-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:40:35.517-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:40:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:40:43.327-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5883026b9527cdec667c0dba 2017-01-21T01:40:43.917-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T01:41:02.306-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5883027e9527cdec667c0dbb 2017-01-21T01:41:03.001-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T01:41:05.809-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:41:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:41:36.086-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:41:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:41:57.956-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588302b59527cdec667c0dbc 2017-01-21T01:41:58.490-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T01:42:06.287-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:42:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:42:23.006-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588302ce9527cdec667c0dbd 2017-01-21T01:42:23.529-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T01:42:36.553-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:42:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:43:06.780-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:43:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:43:24.419-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:43:24.419-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:43:30.549-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:43:30.549-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:43:37.162-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:43:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:44:07.431-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:44:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:44:37.721-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:44:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:45:07.915-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:45:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:45:38.183-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:45:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:46:08.565-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:46:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:46:38.871-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:46:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:47:09.181-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:47:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:47:39.452-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:47:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:47:57.877-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:47:57.877-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:48:04.062-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('58830423649f6ce26861a03b') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1484981283931), why: "doing balance round", ts: ObjectId('588304239527cdec667c0dc1') } } gle1: { lastOp: Timestamp 1484981283000|52, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 28, writtenTo: null, err: null, waited: 28, ok: 1.0 } gle2: { lastOp: Timestamp 1484980943000|30, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 11, writtenTo: null, err: null, waited: 11, ok: 1.0 } 2017-01-21T01:48:04.072-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-21T01:48:04.208-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588304239527cdec667c0dc1 2017-01-21T01:48:04.881-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T01:48:09.744-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:48:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:48:40.137-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:48:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:48:41.555-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588304499527cdec667c0dc2 2017-01-21T01:48:42.261-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T01:49:06.950-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588304629527cdec667c0dc3 2017-01-21T01:49:07.593-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T01:49:10.461-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:49:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:49:40.699-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:49:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:49:44.409-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588304889527cdec667c0dc4 2017-01-21T01:49:45.149-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T01:50:11.066-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:50:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:50:33.792-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:50:33.792-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:50:40.008-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:50:40.008-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:50:41.347-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:50:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:51:11.683-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:51:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:51:35.102-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588304f69527cdec667c0dc7 2017-01-21T01:51:35.702-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T01:51:41.856-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:51:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:52:12.086-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:52:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:52:36.477-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:52:36.477-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:52:42.375-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:52:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:52:54.926-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588305469527cdec667c0dc9 2017-01-21T01:52:55.582-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T01:53:01.903-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5883054d9527cdec667c0dca 2017-01-21T01:53:02.436-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T01:53:12.689-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:53:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:53:42.965-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:53:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:54:13.449-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:54:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:54:15.546-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588305979527cdec667c0dcb 2017-01-21T01:54:16.114-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T01:54:43.746-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:54:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:55:14.035-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:55:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:55:23.181-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588305da9527cdec667c0dcc 2017-01-21T01:55:23.851-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T01:55:36.143-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588305e79527cdec667c0dcd 2017-01-21T01:55:36.776-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-21T01:55:44.308-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:55:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:56:14.568-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:56:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:56:19.543-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:56:19.543-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:56:44.901-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:56:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:57:08.201-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:57:08.201-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:57:15.319-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:57:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:57:44.765-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:57:44.765-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:57:45.725-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:57:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:58:16.039-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:58:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:58:21.405-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:58:21.405-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:58:46.306-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:58:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:59:10.006-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:59:10.006-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:59:16.621-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:59:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:59:22.260-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:59:22.260-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T01:59:46.933-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 01:59:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T01:59:53.142-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-21T01:59:53.143-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-21T02:00:17.214-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:00:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:00:47.496-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:00:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:01:17.794-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:01:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:01:47.942-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:01:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:02:18.234-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:02:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:02:48.532-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:02:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:03:18.873-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:03:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:03:49.164-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:03:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:04:19.457-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:04:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:04:49.748-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:04:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:05:20.036-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:05:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:05:50.286-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:05:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:06:20.433-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:06:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:06:50.719-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:06:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:07:20.961-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:07:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:07:51.254-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:07:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:08:21.421-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:08:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:08:51.572-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:08:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:09:21.774-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:09:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:09:52.045-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:09:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:10:22.252-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:10:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:10:52.408-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:10:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:11:22.568-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:11:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:11:52.819-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:11:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:12:23.103-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:12:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:12:53.376-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:12:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:13:23.635-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:13:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:13:53.920-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:13:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:14:24.292-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:14:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:14:54.612-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:14:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:15:24.919-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:15:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:15:55.159-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:15:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:16:25.430-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:16:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:16:55.574-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:16:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:17:25.872-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:17:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:17:56.016-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:17:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:18:26.308-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:18:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:18:56.655-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:18:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:19:27.021-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:19:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:19:57.282-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:19:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:20:27.581-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:20:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:20:57.741-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:20:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:21:27.894-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:21:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:21:58.157-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:21:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:22:28.341-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:22:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:22:58.571-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:22:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:23:28.834-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:23:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:23:59.062-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:23:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:24:29.355-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:24:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:24:59.632-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:24:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:25:29.931-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:25:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:26:00.225-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:25:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:26:30.514-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:26:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:27:00.778-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:27:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:27:30.970-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:27:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:28:01.120-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:28:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:28:31.385-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:28:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:29:01.577-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:29:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:29:31.867-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:29:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:30:02.137-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:30:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:30:32.417-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:30:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:31:02.658-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:31:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:31:32.938-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:31:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:32:03.284-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:32:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:32:33.689-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:32:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:33:03.935-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:33:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:33:34.224-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:33:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:34:04.498-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:34:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:34:34.802-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:34:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:35:04.936-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:35:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:35:35.419-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:35:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:36:05.703-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:36:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:36:35.953-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:36:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:37:06.250-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:37:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:37:36.515-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:37:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:38:06.837-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:38:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:38:37.060-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:38:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:39:07.348-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:39:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:39:37.636-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:39:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:40:07.910-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:40:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:40:38.295-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:40:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:41:08.578-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:41:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:41:38.740-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:41:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:42:09.238-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:42:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:42:39.503-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:42:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:43:09.799-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:43:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:43:40.097-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:43:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:44:10.361-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:44:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:44:40.726-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:44:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:45:11.007-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:45:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:45:41.204-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:45:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:46:11.485-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:46:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:46:41.782-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:46:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:47:12.075-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:47:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:47:42.306-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:47:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:48:12.455-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:48:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:48:42.620-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:48:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:49:12.841-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:49:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:49:43.174-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:49:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:50:13.539-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:50:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:50:43.729-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:50:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:51:14.034-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:51:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:51:44.255-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:51:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:52:14.588-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:52:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:52:44.862-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:52:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:53:15.149-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:53:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:53:45.412-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:53:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:54:15.698-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:54:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:54:46.204-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:54:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:55:16.491-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:55:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:55:46.758-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:55:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:56:17.059-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:56:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:56:47.400-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:56:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:57:17.585-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:57:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:57:47.927-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:57:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:58:18.204-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:58:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:58:48.438-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:58:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:59:18.640-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:59:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T02:59:48.917-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 02:59:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:00:19.519-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:00:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:00:49.878-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:00:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:01:20.399-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:01:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:01:50.687-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:01:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:02:21.025-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:02:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:02:51.302-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:02:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:03:21.592-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:03:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:03:51.743-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:03:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:04:22.132-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:04:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:04:52.517-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:04:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:05:22.780-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:05:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:05:53.056-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:05:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:06:23.350-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:06:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:06:53.688-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:06:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:07:23.963-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:07:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:07:54.106-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:07:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:08:24.435-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:08:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:08:54.733-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:08:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:09:24.869-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:09:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:09:55.041-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:09:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:10:25.341-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:10:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:10:55.642-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:10:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:11:25.951-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:11:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:11:56.154-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:11:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:12:26.435-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:12:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:12:56.692-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:12:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:13:26.978-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:13:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:13:57.196-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:13:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:14:27.485-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:14:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:14:57.770-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:14:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:15:27.936-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:15:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:15:58.222-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:15:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:16:28.497-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:16:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:16:58.769-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:16:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:17:29.053-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:17:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:17:59.442-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:17:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:18:29.586-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:18:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:18:59.864-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:18:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:19:30.139-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:19:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:20:00.435-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:20:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:20:30.657-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:20:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:21:00.806-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:21:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:21:31.118-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:21:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:22:01.411-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:22:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:22:31.614-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:22:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:23:01.900-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:23:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:23:32.062-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:23:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:24:02.360-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:24:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:24:32.894-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:24:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:25:03.215-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:25:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:25:33.511-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:25:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:26:03.791-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:26:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:26:34.075-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:26:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:27:04.365-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:27:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:27:34.560-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:27:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:28:04.836-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:28:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:28:35.100-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:28:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:29:05.381-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:29:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:29:35.672-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:29:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:30:05.943-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:30:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:30:36.217-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:30:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:31:06.451-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:31:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:31:36.724-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:31:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:32:06.999-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:32:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:32:37.282-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:32:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:33:07.540-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:33:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:33:37.705-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:33:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:34:07.984-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:34:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:34:38.311-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:34:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:35:08.613-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:35:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:35:38.886-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:35:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:36:09.035-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:36:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:36:39.341-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:36:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:37:09.581-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:37:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:37:39.746-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:37:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:38:09.908-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:38:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:38:40.202-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:38:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:39:10.511-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:39:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:39:40.839-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:39:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:40:11.130-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:40:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:40:41.406-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:40:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:41:11.711-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:41:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:41:41.981-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:41:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:42:12.241-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:42:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:42:42.516-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:42:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:43:12.769-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:43:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:43:43.050-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:43:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:44:13.210-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:44:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:44:43.475-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:44:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:45:13.828-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:45:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:45:44.117-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:45:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:46:14.438-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:46:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:46:44.645-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:46:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:47:14.994-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:47:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:47:45.180-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:47:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:48:15.304-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:48:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:48:45.539-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:48:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:49:15.708-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:49:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:49:46.177-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:49:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:50:16.473-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:50:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:50:46.772-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:50:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:51:17.053-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:51:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:51:47.230-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:51:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:52:17.498-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:52:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:52:47.792-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:52:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:53:18.086-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:53:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:53:48.368-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:53:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:54:18.573-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:54:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:54:48.713-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:54:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:55:19.128-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:55:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:55:49.373-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:55:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:56:19.640-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:56:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:56:49.796-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:56:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:57:19.974-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:57:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:57:50.349-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:57:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:58:20.556-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:58:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:58:50.723-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:58:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:59:20.999-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:59:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T03:59:51.275-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 03:59:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:00:21.565-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:00:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:00:51.827-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:00:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:01:21.994-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:01:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:01:52.290-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:01:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:02:22.550-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:02:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:02:52.927-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:02:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:03:23.213-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:03:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:03:53.499-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:03:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:04:23.770-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:04:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:04:53.986-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:04:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:05:24.280-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:05:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:05:54.570-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:05:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:06:24.876-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:06:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:06:55.224-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:06:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:07:25.491-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:07:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:07:55.768-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:07:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:08:26.055-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:08:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:08:56.347-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:08:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:09:26.491-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:09:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:09:56.619-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:09:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:10:26.762-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:10:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:10:56.968-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:10:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:11:27.351-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:11:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:11:57.505-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:11:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:12:27.785-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:12:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:12:58.165-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:12:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:13:28.444-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:13:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:13:58.670-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:13:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:14:28.972-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:14:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:14:59.279-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:14:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:15:29.562-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:15:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:15:59.874-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:15:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:16:30.175-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:16:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:17:00.544-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:17:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:17:30.823-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:17:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:18:01.268-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:18:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:18:31.551-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:18:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:19:01.899-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:19:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:19:32.184-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:19:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:20:02.462-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:20:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:20:32.757-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:20:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:21:03.020-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:21:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:21:33.310-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:21:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:22:03.470-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:22:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:22:33.661-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:22:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:23:03.925-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:23:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:23:34.225-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:23:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:24:04.531-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:24:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:24:34.831-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:24:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:25:05.103-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:25:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:25:35.386-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:25:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:26:05.668-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:26:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:26:35.845-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:26:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:27:05.996-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:27:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:27:36.267-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:27:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:28:06.547-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:28:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:28:36.876-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:28:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:29:07.275-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:29:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:29:37.554-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:29:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:30:07.840-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:30:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:30:38.130-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:30:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:31:08.385-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:31:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:31:38.610-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:31:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:32:08.754-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:32:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:32:38.892-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:32:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:33:09.172-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:33:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:33:39.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:33:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:34:09.657-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:34:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:34:39.962-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:34:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:35:10.252-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:35:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:35:40.530-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:35:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:36:10.746-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:36:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:36:41.009-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:36:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:37:11.273-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:37:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:37:41.418-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:37:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:38:11.577-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:38:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:38:41.866-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:38:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:39:12.246-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:39:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:39:42.430-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:39:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:40:12.804-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:40:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:40:43.082-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:40:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:41:13.354-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:41:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:41:43.624-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:41:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:42:13.792-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:42:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:42:44.110-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:42:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:43:14.262-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:43:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:43:44.570-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:43:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:44:14.806-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:44:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:44:45.082-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:44:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:45:15.385-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:45:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:45:45.637-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:45:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:46:15.857-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:46:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:46:46.240-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:46:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:47:16.435-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:47:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:47:46.749-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:47:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:48:17.039-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:48:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:48:47.383-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:48:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:49:17.542-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:49:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:49:47.798-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:49:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:50:18.110-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:50:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:50:48.397-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:50:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:51:18.665-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:51:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:51:48.943-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:51:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:52:19.224-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:52:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:52:49.477-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:52:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:53:19.759-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:53:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:53:50.250-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:53:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:54:20.484-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:54:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:54:50.777-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:54:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:55:21.067-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:55:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:55:51.346-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:55:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:56:21.584-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:56:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:56:51.736-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:56:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:57:22.082-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:57:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:57:52.363-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:57:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:58:22.588-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:58:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:58:52.741-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:58:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:59:23.101-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:59:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T04:59:53.416-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 04:59:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:00:23.714-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:00:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:00:53.924-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:00:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:01:24.114-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:01:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:01:54.390-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:01:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:02:24.545-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:02:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:02:54.802-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:02:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:03:25.019-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:03:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:03:55.299-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:03:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:04:25.583-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:04:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:04:55.766-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:04:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:05:26.066-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:05:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:05:56.380-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:05:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:06:26.570-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:06:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:06:56.820-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:06:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:07:27.088-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:07:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:07:57.246-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:07:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:08:27.518-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:08:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:08:57.799-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:08:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:09:28.067-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:09:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:09:58.230-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:09:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:10:28.516-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:10:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:10:58.820-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:10:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:11:29.103-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:11:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:11:59.402-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:11:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:12:29.557-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:12:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:12:59.980-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:12:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:13:30.248-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:13:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:14:00.600-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:14:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:14:30.853-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:14:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:15:01.082-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:15:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:15:31.271-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:15:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:16:01.646-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:16:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:16:32.120-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:16:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:17:02.400-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:17:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:17:32.583-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:17:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:18:02.880-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:18:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:18:33.162-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:18:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:19:03.363-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:19:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:19:33.596-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:19:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:20:03.760-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:20:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:20:34.064-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:20:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:21:04.220-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:21:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:21:34.497-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:21:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:22:04.833-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:22:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:22:35.139-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:22:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:23:05.392-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:23:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:23:35.659-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:23:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:24:05.829-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:24:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:24:36.016-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:24:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:25:06.208-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:25:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:25:36.500-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:25:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:26:06.647-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:26:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:26:36.931-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:26:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:27:07.227-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:27:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:27:37.525-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:27:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:28:07.802-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:28:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:28:38.144-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:28:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:29:08.328-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:29:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:29:38.667-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:29:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:30:08.961-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:30:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:30:39.230-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:30:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:31:09.389-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:31:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:31:39.771-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:31:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:32:10.114-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:32:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:32:40.445-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:32:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:33:10.800-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:33:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:33:41.005-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:33:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:34:11.301-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:34:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:34:41.507-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:34:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:35:11.822-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:35:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:35:42.051-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:35:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:36:12.248-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:36:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:36:42.516-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:36:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:37:12.846-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:37:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:37:43.093-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:37:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:38:13.530-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:38:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:38:43.932-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:38:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:39:14.208-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:39:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:39:44.504-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:39:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:40:14.776-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:40:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:40:45.062-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:40:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:41:15.338-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:41:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:41:45.588-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:41:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:42:15.891-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:42:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:42:46.154-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:42:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:43:16.448-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:43:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:43:46.598-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:43:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:44:16.892-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:44:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:44:47.198-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:44:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:45:17.523-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:45:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:45:47.700-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:45:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:46:17.963-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:46:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:46:48.255-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:46:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:47:18.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:47:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:47:48.766-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:47:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:48:19.047-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:48:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:48:49.393-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:48:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:49:19.674-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:49:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:49:49.965-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:49:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:50:20.241-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:50:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:50:50.552-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:50:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:51:20.854-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:51:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:51:51.191-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:51:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:52:21.403-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:52:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:52:51.669-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:52:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:53:21.991-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:53:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:53:52.309-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:53:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:54:22.532-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:54:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:54:52.805-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:54:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:55:23.106-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:55:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:55:53.400-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:55:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:56:23.700-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:56:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:56:53.969-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:56:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:57:24.307-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:57:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:57:54.560-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:57:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:58:24.832-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:58:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:58:55.123-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:58:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:59:25.407-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:59:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T05:59:55.681-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 05:59:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:00:26.017-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:00:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:00:56.261-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:00:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:01:26.616-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:01:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:01:56.891-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:01:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:02:27.161-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:02:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:02:57.582-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:02:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:03:27.870-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:03:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:03:58.151-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:03:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:04:28.434-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:04:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:04:58.645-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:04:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:05:28.785-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:05:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:05:59.068-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:05:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:06:29.343-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:06:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:06:59.602-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:06:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:07:30.027-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:07:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:08:00.331-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:08:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:08:30.775-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:08:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:09:01.049-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:09:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:09:31.321-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:09:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:10:01.629-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:10:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:10:31.836-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:10:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:11:02.129-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:11:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:11:32.447-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:11:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:12:02.793-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:12:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:12:33.148-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:12:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:13:03.321-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:13:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:13:33.468-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:13:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:14:03.855-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:14:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:14:34.144-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:14:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:15:04.410-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:15:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:15:34.678-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:15:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:16:05.009-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:16:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:16:35.175-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:16:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:17:05.464-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:17:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:17:35.763-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:17:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:18:06.020-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:18:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:18:36.311-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:18:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:19:06.469-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:19:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:19:36.706-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:19:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:20:06.940-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:20:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:20:37.225-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:20:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:21:07.616-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:21:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:21:37.918-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:21:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:22:08.187-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:22:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:22:38.339-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:22:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:23:08.512-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:23:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:23:38.796-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:23:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:24:09.097-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:24:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:24:39.470-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:24:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:25:09.791-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:25:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:25:40.097-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:25:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:26:10.380-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:26:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:26:40.672-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:26:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:27:10.824-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:27:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:27:41.189-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:27:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:28:11.468-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:28:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:28:41.757-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:28:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:29:12.115-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:29:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:29:42.406-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:29:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:30:12.731-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:30:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:30:42.925-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:30:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:31:13.266-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:31:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:31:43.564-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:31:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:32:13.847-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:32:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:32:44.126-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:32:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:33:14.389-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:33:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:33:44.678-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:33:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:34:14.934-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:34:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:34:45.210-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:34:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:35:15.515-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:35:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:35:45.780-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:35:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:36:15.964-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:36:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:36:46.247-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:36:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:37:16.647-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:37:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:37:46.897-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:37:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:38:17.033-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:38:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:38:47.280-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:38:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:39:17.470-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:39:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:39:47.870-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:39:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:40:18.152-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:40:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:40:48.447-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:40:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:41:18.723-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:41:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:41:49.007-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:41:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:42:19.193-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:42:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:42:49.545-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:42:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:43:19.835-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:43:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:43:50.226-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:43:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:44:20.527-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:44:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:44:50.875-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:44:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:45:21.158-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:45:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:45:51.524-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:45:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:46:21.681-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:46:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:46:51.940-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:46:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:47:22.239-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:47:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:47:52.370-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:47:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:48:22.664-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:48:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:48:52.935-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:48:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:49:23.231-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:49:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:49:53.442-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:49:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:50:23.799-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:50:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:50:54.098-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:50:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:51:24.384-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:51:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:51:54.515-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:51:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:52:24.795-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:52:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:52:55.059-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:52:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:53:25.349-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:53:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:53:55.620-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:53:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:54:25.760-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:54:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:54:56.048-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:54:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:55:26.345-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:55:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:55:56.649-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:55:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:56:26.881-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:56:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:56:57.189-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:56:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:57:27.450-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:57:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:57:57.720-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:57:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:58:28.013-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:58:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:58:58.247-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:58:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:59:28.434-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:59:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T06:59:58.627-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 06:59:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:00:28.912-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:00:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:00:59.070-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:00:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:01:29.290-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:01:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:01:59.581-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:01:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:02:29.899-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:02:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:03:00.104-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:02:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:03:30.408-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:03:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:04:00.679-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:04:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:04:30.831-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:04:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:05:01.153-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:05:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:05:31.444-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:05:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:06:01.719-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:06:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:06:31.969-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:06:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:07:02.253-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:07:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:07:32.542-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:07:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:08:02.817-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:08:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:08:33.141-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:08:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:09:03.420-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:09:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:09:33.700-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:09:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:10:04.093-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:10:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:10:34.241-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:10:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:11:04.503-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:11:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:11:34.651-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:11:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:12:04.915-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:12:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:12:35.067-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:12:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:13:05.286-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:13:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:13:35.598-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:13:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:14:05.840-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:14:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:14:36.033-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:14:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:15:06.216-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:15:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:15:36.498-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:15:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:16:06.740-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:16:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:16:36.947-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:16:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:17:07.292-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:17:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:17:37.583-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:17:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:18:07.740-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:18:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:18:37.948-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:18:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:19:08.193-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:19:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:19:38.464-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:19:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:20:08.755-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:20:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:20:39.074-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:20:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:21:09.372-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:21:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:21:39.554-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:21:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:22:09.798-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:22:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:22:40.078-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:22:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:23:10.362-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:23:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:23:40.576-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:23:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:24:10.918-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:24:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:24:41.151-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:24:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:25:11.362-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:25:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:25:41.668-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:25:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:26:11.954-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:26:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:26:42.240-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:26:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:27:12.389-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:27:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:27:42.668-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:27:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:28:12.826-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:28:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:28:43.025-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:28:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:29:13.431-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:29:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:29:43.681-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:29:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:30:13.936-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:30:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:30:44.222-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:30:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:31:14.501-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:31:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:31:44.784-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:31:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:32:15.060-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:32:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:32:45.266-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:32:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:33:15.526-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:33:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:33:45.815-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:33:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:34:16.070-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:34:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:34:46.351-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:34:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:35:16.665-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:35:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:35:47.043-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:35:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:36:17.212-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:36:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:36:47.496-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:36:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:37:17.805-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:37:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:37:48.022-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:37:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:38:18.301-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:38:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:38:48.584-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:38:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:39:18.867-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:39:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:39:49.132-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:39:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:40:19.373-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:40:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:40:49.692-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:40:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:41:19.903-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:41:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:41:50.144-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:41:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:42:20.406-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:42:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:42:50.678-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:42:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:43:21.121-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:43:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:43:51.409-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:43:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:44:21.596-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:44:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:44:51.876-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:44:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:45:22.055-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:45:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:45:52.366-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:45:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:46:22.624-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:46:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:46:52.876-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:46:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:47:23.145-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:47:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:47:53.413-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:47:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:48:23.744-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:48:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:48:54.028-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:48:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:49:24.272-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:49:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:49:54.626-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:49:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:50:24.906-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:50:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:50:55.152-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:50:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:51:25.426-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:51:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:51:55.715-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:51:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:52:26.006-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:52:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:52:56.261-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:52:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:53:26.591-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:53:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:53:56.855-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:53:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:54:27.144-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:54:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:54:57.426-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:54:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:55:27.658-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:55:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:55:57.928-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:55:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:56:28.224-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:56:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:56:58.489-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:56:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:57:28.832-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:57:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:57:58.995-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:57:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:58:29.294-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:58:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:58:59.569-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:58:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T07:59:29.734-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:59:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:00:00.025-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 07:59:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:00:30.408-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:00:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:01:00.618-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:01:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:01:30.878-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:01:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:02:01.087-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:02:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:02:31.232-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:02:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:03:01.511-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:03:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:03:31.938-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:03:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:04:02.201-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:04:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:04:32.530-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:04:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:05:02.795-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:05:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:05:33.052-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:05:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:06:03.397-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:06:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:06:33.711-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:06:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:07:03.893-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:07:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:07:34.241-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:07:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:08:04.539-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:08:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:08:34.778-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:08:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:09:05.005-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:09:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:09:35.173-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:09:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:10:05.394-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:10:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:10:35.670-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:10:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:11:05.913-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:11:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:11:36.167-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:11:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:12:06.444-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:12:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:12:36.767-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:12:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:13:06.912-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:13:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:13:37.244-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:13:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:14:07.389-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:14:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:14:37.584-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:14:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:15:07.849-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:15:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:15:38.140-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:15:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:16:08.358-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:16:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:16:38.789-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:16:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:17:08.952-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:17:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:17:39.294-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:17:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:18:09.672-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:18:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:18:39.901-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:18:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:19:10.191-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:19:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:19:40.349-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:19:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:20:10.578-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:20:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:20:40.989-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:20:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:21:11.231-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:21:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:21:41.590-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:21:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:22:11.736-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:22:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:22:41.976-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:22:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:23:12.249-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:23:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:23:42.435-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:23:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:24:12.572-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:24:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:24:42.852-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:24:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:25:13.316-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:25:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:25:43.723-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:25:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:26:14.048-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:26:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:26:44.349-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:26:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:27:14.644-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:27:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:27:44.948-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:27:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:28:15.090-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:28:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:28:45.375-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:28:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:29:15.568-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:29:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:29:45.851-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:29:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:30:16.017-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:30:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:30:46.341-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:30:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:31:16.627-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:31:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:31:46.798-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:31:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:32:17.096-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:32:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:32:47.435-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:32:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:33:17.729-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:33:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:33:47.955-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:33:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:34:18.216-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:34:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:34:48.475-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:34:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:35:18.738-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:35:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:35:49.018-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:35:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:36:19.312-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:36:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:36:49.513-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:36:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:37:19.796-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:37:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:37:50.142-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:37:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:38:20.354-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:38:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:38:50.815-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:38:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:39:20.953-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:39:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:39:51.081-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:39:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:40:21.351-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:40:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:40:51.636-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:40:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:41:21.909-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:41:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:41:52.204-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:41:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:42:22.490-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:42:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:42:52.775-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:42:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:43:23.064-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:43:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:43:53.245-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:43:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:44:23.586-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:44:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:44:53.727-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:44:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:45:24.007-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:45:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:45:54.442-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:45:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:46:24.599-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:46:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:46:54.967-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:46:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:47:25.250-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:47:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:47:55.532-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:47:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:48:25.801-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:48:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:48:56.145-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:48:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:49:26.326-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:49:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:49:56.613-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:49:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:50:26.879-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:50:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:50:57.260-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:50:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:51:27.539-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:51:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:51:57.829-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:51:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:52:28.102-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:52:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:52:58.453-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:52:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:53:28.733-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:53:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:53:59.021-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:53:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:54:29.263-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:54:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:54:59.462-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:54:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:55:29.640-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:55:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:55:59.991-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:55:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:56:30.286-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:56:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:57:00.572-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:57:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:57:30.891-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:57:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:58:01.164-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:58:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:58:31.426-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:58:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:59:01.593-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:59:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T08:59:31.894-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 08:59:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:00:02.200-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:00:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:00:32.476-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:00:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:01:02.761-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:01:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:01:33.016-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:01:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:02:03.280-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:02:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:02:33.549-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:02:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:03:03.791-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:03:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:03:34.007-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:03:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:04:04.335-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:04:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:04:34.606-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:04:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:05:04.912-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:05:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:05:35.215-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:05:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:06:05.544-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:06:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:06:35.887-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:06:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:07:06.194-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:07:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:07:36.509-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:07:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:08:06.793-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:08:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:08:37.178-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:08:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:09:07.520-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:09:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:09:37.902-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:09:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:10:08.231-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:10:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:10:38.632-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:10:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:11:08.944-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:11:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:11:39.270-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:11:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:12:09.545-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:12:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:12:39.814-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:12:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:13:10.060-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:13:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:13:40.467-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:13:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:14:10.738-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:14:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:14:41.015-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:14:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:15:11.314-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:15:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:15:41.630-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:15:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:16:11.906-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:16:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:16:42.324-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:16:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:17:12.568-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:17:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:17:42.819-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:17:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:18:13.106-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:18:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:18:43.434-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:18:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:19:13.723-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:19:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:19:44.033-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:19:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:20:14.340-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:20:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:20:44.664-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:20:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:21:14.947-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:21:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:21:45.247-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:21:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:22:15.427-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:22:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:22:45.704-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:22:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:23:16.022-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:23:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:23:46.344-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:23:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:24:16.629-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:24:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:24:46.945-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:24:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:25:17.222-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:25:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:25:47.441-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:25:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:26:17.730-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:26:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:26:48.026-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:26:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:27:18.334-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:27:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:27:48.579-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:27:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:28:18.807-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:28:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:28:49.101-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:28:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:29:19.281-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:29:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:29:49.570-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:29:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:30:19.764-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:30:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:30:50.037-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:30:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:31:20.334-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:31:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:31:50.503-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:31:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:32:20.767-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:32:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:32:51.188-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:32:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:33:21.460-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:33:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:33:51.684-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:33:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:34:21.952-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:34:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:34:52.187-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:34:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:35:22.505-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:35:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:35:52.824-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:35:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:36:23.081-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:36:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:36:53.380-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:36:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:37:23.651-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:37:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:37:53.957-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:37:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:38:24.203-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:38:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:38:54.469-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:38:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:39:24.768-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:39:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:39:55.183-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:39:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:40:25.501-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:40:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:40:55.802-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:40:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:41:25.972-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:41:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:41:56.260-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:41:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:42:26.553-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:42:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:42:56.819-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:42:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:43:27.054-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:43:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:43:57.346-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:43:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:44:27.621-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:44:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:44:57.939-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:44:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:45:28.295-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:45:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:45:58.641-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:45:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:46:28.895-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:46:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:46:59.205-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:46:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:47:29.429-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:47:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:47:59.727-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:47:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:48:30.092-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:48:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:49:00.434-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:49:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:49:30.790-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:49:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:50:01.010-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:50:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:50:31.347-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:50:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:51:01.576-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:51:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:51:31.952-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:51:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:52:02.257-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:52:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:52:32.410-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:52:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:53:02.611-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:53:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:53:32.983-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:53:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:54:03.264-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:54:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:54:33.552-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:54:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:55:03.854-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:55:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:55:34.206-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:55:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:56:04.480-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:56:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:56:34.795-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:56:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:57:05.195-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:57:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:57:35.488-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:57:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:58:05.662-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:58:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:58:36.008-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:58:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:59:06.422-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:59:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T09:59:37.296-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 09:59:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:00:07.724-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:00:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:00:38.012-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:00:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:01:08.291-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:01:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:01:38.536-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:01:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:02:08.926-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:02:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:02:39.306-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:02:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:03:09.640-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:03:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:03:39.906-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:03:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:04:10.212-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:04:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:04:40.513-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:04:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:05:10.834-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:05:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:05:41.082-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:05:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:06:11.448-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:06:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:06:41.819-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:06:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:07:12.174-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:07:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:07:42.402-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:07:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:08:12.761-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:08:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:08:43.109-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:08:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:09:13.466-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:09:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:09:43.727-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:09:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:10:14.017-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:10:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:10:44.243-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:10:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:11:14.570-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:11:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:11:44.796-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:11:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:12:15.259-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:12:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:12:45.492-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:12:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:13:15.868-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:13:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:13:46.294-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:13:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:14:16.530-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:14:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:14:46.716-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:14:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:15:16.977-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:15:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:15:47.181-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:15:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:16:17.468-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:16:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:16:47.744-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:16:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:17:18.031-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:17:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:17:48.341-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:17:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:18:18.569-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:18:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:18:48.850-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:18:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:19:19.136-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:19:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:19:49.398-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:19:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:20:19.693-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:20:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:20:49.897-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:20:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:21:20.258-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:21:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:21:50.469-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:21:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:22:20.753-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:22:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:22:51.052-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:22:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:23:21.440-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:23:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:23:51.654-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:23:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:24:22.035-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:24:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:24:52.315-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:24:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:25:22.585-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:25:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:25:52.878-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:25:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:26:23.171-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:26:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:26:53.423-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:26:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:27:23.750-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:27:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:27:54.047-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:27:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:28:24.431-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:28:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:28:54.753-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:28:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:29:25.043-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:29:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:29:55.435-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:29:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:30:25.791-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:30:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:30:56.061-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:30:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:31:26.363-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:31:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:31:56.577-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:31:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:32:26.851-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:32:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:32:57.090-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:32:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:33:27.385-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:33:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:33:57.701-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:33:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:34:28.042-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:34:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:34:58.404-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:34:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:35:28.715-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:35:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:35:59.016-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:35:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:36:29.286-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:36:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:36:59.503-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:36:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:37:29.721-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:37:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:37:59.999-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:37:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:38:30.283-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:38:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:39:00.569-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:39:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:39:30.855-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:39:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:40:01.264-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:40:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:40:31.538-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:40:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:41:01.885-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:41:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:41:32.155-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:41:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:42:02.498-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:42:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:42:32.787-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:42:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:43:03.050-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:43:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:43:33.347-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:43:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:44:03.525-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:44:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:44:33.910-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:44:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:45:04.085-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:45:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:45:34.355-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:45:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:46:04.571-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:46:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:46:34.858-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:46:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:47:05.142-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:47:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:47:35.401-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:47:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:48:05.723-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:48:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:48:36.024-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:48:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:49:06.312-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:49:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:49:36.443-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:49:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:50:06.806-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:50:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:50:37.127-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:50:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:51:07.417-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:51:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:51:37.797-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:51:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:52:08.078-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:52:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:52:38.273-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:52:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:53:08.634-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:53:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:53:38.981-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:53:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:54:09.269-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:54:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:54:39.438-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:54:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:55:09.704-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:55:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:55:39.909-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:55:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:56:10.101-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:56:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:56:40.405-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:56:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:57:10.708-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:57:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:57:40.988-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:57:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:58:11.219-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:58:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:58:41.501-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:58:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:59:11.772-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:59:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T10:59:42.005-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 10:59:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:00:12.294-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:00:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:00:42.556-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:00:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:01:12.859-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:01:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:01:43.128-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:01:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:02:13.523-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:02:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:02:43.837-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:02:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:03:14.085-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:03:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:03:44.479-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:03:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:04:14.866-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:04:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:04:45.418-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:04:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:05:15.789-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:05:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:05:46.062-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:05:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:06:16.342-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:06:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:06:46.596-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:06:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:07:16.928-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:07:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:07:47.187-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:07:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:08:17.426-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:08:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:08:47.696-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:08:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:09:17.992-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:09:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:09:48.283-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:09:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:10:18.491-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:10:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:10:48.846-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:10:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:11:19.119-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:11:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:11:49.436-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:11:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:12:19.790-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:12:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:12:50.040-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:12:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:13:20.199-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:13:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:13:50.562-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:13:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:14:20.908-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:14:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:14:51.180-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:14:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:15:21.529-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:15:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:15:51.840-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:15:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:16:22.110-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:16:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:16:52.306-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:16:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:17:22.557-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:17:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:17:52.772-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:17:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:18:23.051-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:18:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:18:53.291-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:18:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:19:23.598-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:19:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:19:53.875-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:19:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:20:24.106-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:20:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:20:54.447-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:20:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:21:24.746-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:21:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:21:55.026-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:21:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:22:25.429-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:22:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:22:55.812-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:22:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:23:26.090-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:23:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:23:56.423-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:23:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:24:26.758-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:24:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:24:57.095-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:24:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:25:27.375-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:25:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:25:57.816-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:25:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:26:28.063-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:26:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:26:58.414-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:26:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:27:28.630-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:27:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:27:58.917-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:27:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:28:29.209-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:28:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:28:59.502-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:28:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:29:29.893-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:29:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:30:00.166-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:29:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:30:30.483-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:30:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:31:00.710-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:31:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:31:31.008-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:31:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:32:01.338-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:32:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:32:31.654-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:32:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:33:01.883-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:33:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:33:32.168-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:33:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:34:02.403-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:34:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:34:32.701-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:34:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:35:03.041-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:35:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:35:33.280-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:35:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:36:03.676-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:36:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:36:34.007-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:36:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:37:04.268-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:37:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:37:34.554-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:37:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:38:04.824-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:38:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:38:35.111-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:38:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:39:05.400-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:39:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:39:35.664-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:39:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:40:05.804-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:40:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:40:36.083-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:40:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:41:06.335-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:41:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:41:36.545-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:41:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:42:06.824-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:42:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:42:36.974-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:42:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:43:07.268-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:43:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:43:37.457-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:43:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:44:07.765-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:44:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:44:38.133-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:44:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:45:08.420-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:45:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:45:38.780-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:45:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:46:09.056-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:46:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:46:39.336-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:46:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:47:09.495-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:47:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:47:39.712-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:47:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:48:09.886-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:48:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:48:40.174-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:48:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:49:10.515-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:49:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:49:40.790-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:49:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:50:10.948-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:50:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:50:41.334-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:50:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:51:11.497-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:51:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:51:41.859-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:51:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:52:12.163-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:52:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:52:42.459-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:52:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:53:12.775-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:53:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:53:43.050-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:53:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:54:13.476-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:54:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:54:43.627-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:54:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:55:13.886-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:55:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:55:44.159-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:55:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:56:14.612-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:56:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:56:44.895-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:56:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:57:15.067-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:57:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:57:45.217-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:57:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:58:15.361-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:58:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:58:45.689-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:58:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:59:16.259-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:59:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T11:59:46.554-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 11:59:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:00:16.864-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:00:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:00:47.226-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:00:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:01:17.498-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:01:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:01:47.685-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:01:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:02:17.966-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:02:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:02:48.150-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:02:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:03:18.313-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:03:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:03:48.581-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:03:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:04:18.744-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:04:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:04:48.979-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:04:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:05:19.124-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:05:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:05:49.290-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:05:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:06:19.528-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:06:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:06:49.876-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:06:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:07:20.106-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:07:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:07:50.408-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:07:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:08:20.650-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:08:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:08:51.019-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:08:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:09:21.159-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:09:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:09:51.312-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:09:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:10:21.588-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:10:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:10:51.914-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:10:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:11:22.199-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:11:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:11:52.512-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:11:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:12:22.892-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:12:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:12:53.167-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:12:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:13:23.451-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:13:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:13:53.791-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:13:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:14:24.166-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:14:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:14:54.464-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:14:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:15:24.805-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:15:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:15:55.125-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:15:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:16:25.432-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:16:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:16:55.729-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:16:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:17:26.012-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:17:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:17:56.312-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:17:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:18:26.596-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:18:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:18:56.876-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:18:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:19:27.263-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:19:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:19:57.654-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:19:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:20:27.939-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:20:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:20:58.244-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:20:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:21:28.527-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:21:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:21:58.722-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:21:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:22:29.008-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:22:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:22:59.178-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:22:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:23:29.504-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:23:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:23:59.798-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:23:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:24:30.082-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:24:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:25:00.354-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:25:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:25:30.612-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:25:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:26:00.760-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:26:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:26:31.016-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:26:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:27:01.249-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:27:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:27:31.412-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:27:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:28:01.695-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:28:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:28:31.952-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:28:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:29:02.115-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:29:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:29:32.411-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:29:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:30:02.678-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:30:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:30:32.953-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:30:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:31:03.216-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:31:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:31:33.407-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:31:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:32:03.799-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:32:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:32:34.092-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:32:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:33:04.383-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:33:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:33:34.681-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:33:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:34:05.004-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:34:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:34:35.307-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:34:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:35:05.609-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:35:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:35:35.883-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:35:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:36:06.184-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:36:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:36:36.486-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:36:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:37:06.647-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:37:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:37:36.911-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:37:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:38:07.224-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:38:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:38:37.502-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:38:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:39:07.774-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:39:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:39:38.073-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:39:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:40:08.253-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:40:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:40:38.533-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:40:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:41:08.741-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:41:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:41:38.870-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:41:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:42:09.131-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:42:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:42:39.590-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:42:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:43:10.050-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:43:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:43:40.324-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:43:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:44:10.568-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:44:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:44:40.883-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:44:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:45:11.169-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:45:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:45:41.341-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:45:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:46:11.648-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:46:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:46:41.925-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:46:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:47:12.255-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:47:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:47:42.534-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:47:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:48:12.774-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:48:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:48:43.048-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:48:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:49:13.223-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:49:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:49:43.496-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:49:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:50:13.653-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:50:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:50:43.892-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:50:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:51:14.161-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:51:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:51:44.419-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:51:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:52:14.700-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:52:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:52:44.926-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:52:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:53:15.334-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:53:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:53:45.497-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:53:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:54:15.637-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:54:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:54:45.935-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:54:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:55:16.076-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:55:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:55:46.391-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:55:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:56:16.604-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:56:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:56:46.907-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:56:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:57:17.069-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:57:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:57:47.306-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:57:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:58:17.606-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:58:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:58:47.888-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:58:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:59:18.234-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:59:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T12:59:48.541-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 12:59:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:00:18.890-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:00:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:00:49.170-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:00:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:01:19.308-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:01:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:01:49.601-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:01:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:02:19.862-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:02:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:02:50.030-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:02:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:03:20.305-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:03:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:03:50.471-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:03:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:04:20.666-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:04:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:04:50.815-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:04:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:05:21.123-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:05:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:05:51.512-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:05:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:06:21.830-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:06:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:06:52.035-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:06:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:07:22.314-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:07:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:07:52.602-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:07:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:08:22.892-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:08:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:08:53.177-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:08:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:09:23.519-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:09:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:09:53.811-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:09:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:10:24.097-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:10:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:10:54.446-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:10:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:11:24.792-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:11:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:11:54.938-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:11:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:12:25.354-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:12:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:12:55.576-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:12:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:13:25.870-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:13:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:13:56.168-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:13:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:14:26.433-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:14:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:14:56.644-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:14:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:15:26.790-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:15:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:15:57.064-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:15:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:16:27.204-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:16:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:16:57.497-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:16:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:17:27.800-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:17:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:17:58.072-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:17:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:18:28.415-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:18:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:18:58.573-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:18:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:19:28.862-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:19:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:19:59.193-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:19:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:20:29.494-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:20:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:20:59.789-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:20:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:21:30.060-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:21:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:22:00.393-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:22:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:22:30.671-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:22:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:23:00.835-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:23:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:23:31.112-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:23:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:24:01.395-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:24:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:24:31.873-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:24:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:25:02.245-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:25:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:25:32.511-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:25:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:26:02.781-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:26:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:26:33.067-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:26:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:27:03.336-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:27:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:27:33.604-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:27:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:28:03.915-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:28:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:28:34.235-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:28:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:29:04.404-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:29:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:29:34.572-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:29:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:30:04.858-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:30:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:30:35.291-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:30:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:31:05.618-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:31:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:31:35.917-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:31:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:32:06.073-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:32:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:32:36.345-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:32:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:33:06.640-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:33:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:33:36.797-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:33:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:34:07.167-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:34:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:34:37.387-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:34:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:35:07.694-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:35:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:35:38.068-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:35:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:36:08.334-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:36:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:36:38.626-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:36:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:37:08.914-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:37:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:37:39.185-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:37:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:38:09.447-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:38:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:38:39.723-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:38:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:39:09.990-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:39:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:39:40.320-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:39:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:40:10.708-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:40:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:40:40.890-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:40:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:41:11.145-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:41:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:41:41.444-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:41:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:42:11.717-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:42:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:42:41.952-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:42:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:43:12.235-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:43:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:43:42.498-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:43:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:44:12.773-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:44:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:44:43.076-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:44:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:45:13.420-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:45:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:45:43.649-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:45:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:46:13.887-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:46:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:46:44.178-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:46:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:47:14.318-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:47:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:47:44.587-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:47:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:48:14.755-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:48:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:48:45.012-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:48:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:49:15.436-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:49:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:49:45.692-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:49:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:50:16.022-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:50:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:50:46.326-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:50:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:51:16.735-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:51:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:51:46.982-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:51:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:52:17.277-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:52:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:52:47.483-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:52:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:53:17.730-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:53:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:53:48.009-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:53:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:54:18.267-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:54:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:54:48.602-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:54:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:55:18.881-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:55:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:55:49.160-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:55:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:56:19.624-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:56:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:56:49.997-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:56:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:57:20.181-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:57:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:57:50.483-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:57:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:58:20.885-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:58:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:58:51.191-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:58:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:59:21.452-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:59:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T13:59:51.713-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 13:59:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:00:22.098-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:00:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:00:52.365-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:00:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:01:22.703-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:01:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:01:52.988-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:01:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:02:23.154-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:02:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:02:53.392-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:02:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:03:23.662-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:03:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:03:53.869-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:03:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:04:24.142-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:04:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:04:54.490-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:04:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:05:24.848-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:05:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:05:55.116-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:05:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:06:25.408-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:06:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:06:55.686-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:06:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:07:25.981-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:07:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:07:56.370-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:07:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:08:26.793-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:08:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:08:57.106-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:08:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:09:27.394-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:09:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:09:57.560-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:09:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:10:27.860-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:10:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:10:58.137-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:10:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:11:28.411-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:11:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:11:58.679-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:11:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:12:28.968-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:12:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:12:59.118-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:12:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:13:29.423-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:13:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:13:59.688-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:13:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:14:29.921-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:14:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:15:00.179-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:14:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:15:30.313-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:15:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:16:00.568-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:16:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:16:30.844-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:16:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:17:01.153-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:17:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:17:31.515-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:17:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:18:01.809-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:18:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:18:32.127-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:18:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:19:02.450-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:19:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:19:32.718-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:19:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:20:03.001-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:20:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:20:33.261-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:20:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:21:03.535-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:21:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:21:33.834-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:21:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:22:04.044-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:22:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:22:34.319-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:22:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:23:04.645-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:23:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:23:34.934-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:23:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:24:05.218-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:24:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:24:35.495-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:24:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:25:05.777-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:25:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:25:36.080-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:25:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:26:06.368-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:26:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:26:36.736-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:26:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:27:07.070-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:27:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:27:37.332-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:27:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:28:07.831-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:28:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:28:38.097-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:28:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:29:08.388-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:29:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:29:38.692-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:29:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:30:08.943-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:30:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:30:39.083-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:30:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:31:09.227-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:31:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:31:39.370-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:31:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:32:09.628-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:32:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:32:39.915-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:32:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:33:10.089-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:33:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:33:40.373-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:33:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:34:10.694-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:34:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:34:41.093-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:34:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:35:11.250-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:35:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:35:41.544-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:35:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:36:11.893-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:36:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:36:42.246-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:36:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:37:12.402-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:37:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:37:42.696-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:37:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:38:12.967-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:38:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:38:43.162-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:38:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:39:13.423-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:39:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:39:43.700-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:39:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:40:14.049-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:40:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:40:44.313-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:40:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:41:14.638-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:41:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:41:44.919-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:41:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:42:15.220-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:42:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:42:45.512-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:42:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:43:15.811-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:43:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:43:46.064-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:43:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:44:16.439-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:44:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:44:46.626-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:44:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:45:16.985-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:45:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:45:47.261-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:45:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:46:17.567-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:46:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:46:47.851-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:46:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:47:17.985-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:47:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:47:48.347-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:47:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:48:18.593-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:48:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:48:48.952-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:48:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:49:19.309-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:49:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:49:49.657-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:49:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:50:19.927-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:50:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:50:50.207-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:50:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:51:20.600-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:51:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:51:50.918-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:51:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:52:21.182-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:52:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:52:51.495-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:52:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:53:21.825-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:53:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:53:51.979-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:53:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:54:22.169-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:54:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:54:52.631-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:54:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:55:22.911-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:55:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:55:53.107-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:55:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:56:23.281-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:56:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:56:53.502-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:56:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:57:23.702-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:57:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:57:53.948-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:57:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:58:24.125-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:58:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:58:54.462-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:58:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:59:24.733-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:59:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T14:59:55.125-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 14:59:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:00:25.406-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:00:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:00:55.679-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:00:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:01:25.944-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:01:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:01:56.154-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:01:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:02:26.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:02:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:02:56.624-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:02:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:03:26.937-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:03:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:03:57.208-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:03:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:04:27.485-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:04:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:04:57.741-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:04:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:05:28.037-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:05:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:05:58.191-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:05:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:06:28.392-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:06:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:06:58.655-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:06:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:07:28.958-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:07:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:07:59.230-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:07:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:08:29.512-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:08:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:08:59.837-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:08:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:09:30.001-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:09:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:10:00.281-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:10:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:10:30.579-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:10:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:11:00.889-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:11:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:11:31.169-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:11:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:12:01.538-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:12:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:12:31.921-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:12:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:13:02.237-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:13:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:13:32.585-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:13:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:14:02.758-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:14:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:14:32.995-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:14:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:15:03.204-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:15:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:15:33.408-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:15:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:16:03.752-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:16:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:16:34.027-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:16:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:17:04.307-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:17:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:17:34.591-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:17:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:18:04.816-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:18:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:18:34.983-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:18:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:19:05.259-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:19:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:19:35.653-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:19:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:20:05.931-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:20:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:20:36.072-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:20:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:21:06.291-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:21:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:21:36.498-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:21:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:22:06.710-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:22:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:22:37.121-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:22:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:23:07.316-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:23:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:23:37.638-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:23:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:24:08.039-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:24:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:24:38.204-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:24:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:25:08.507-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:25:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:25:38.795-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:25:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:26:09.103-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:26:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:26:39.383-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:26:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:27:09.562-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:27:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:27:39.990-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:27:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:28:10.364-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:28:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:28:40.661-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:28:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:29:10.927-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:29:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:29:41.218-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:29:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:30:11.450-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:30:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:30:41.738-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:30:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:31:12.012-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:31:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:31:42.261-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:31:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:32:12.666-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:32:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:32:42.846-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:32:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:33:13.026-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:33:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:33:43.322-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:33:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:34:13.649-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:34:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:34:43.934-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:34:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:35:14.205-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:35:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:35:44.461-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:35:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:36:14.722-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:36:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:36:44.991-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:36:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:37:15.187-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:37:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:37:45.490-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:37:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:38:15.702-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:38:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:38:45.975-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:38:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:39:16.238-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:39:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:39:46.469-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:39:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:40:16.752-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:40:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:40:47.015-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:40:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:41:17.262-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:41:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:41:47.635-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:41:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:42:17.929-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:42:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:42:48.215-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:42:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:43:18.358-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:43:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:43:48.637-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:43:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:44:18.905-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:44:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:44:49.086-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:44:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:45:19.252-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:45:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:45:49.591-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:45:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:46:19.958-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:46:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:46:50.249-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:46:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:47:20.655-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:47:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:47:50.901-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:47:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:48:21.189-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:48:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:48:51.487-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:48:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:49:21.757-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:49:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:49:51.915-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:49:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:50:22.197-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:50:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:50:52.526-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:50:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:51:22.721-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:51:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:51:53.107-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:51:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:52:23.433-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:52:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:52:53.817-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:52:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:53:24.168-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:53:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:53:54.462-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:53:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:54:24.733-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:54:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:54:54.995-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:54:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:55:25.266-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:55:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:55:55.558-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:55:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:56:25.883-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:56:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:56:56.168-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:56:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:57:26.459-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:57:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:57:56.754-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:57:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:58:27.007-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:58:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:58:57.280-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:58:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:59:27.564-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:59:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T15:59:57.896-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 15:59:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:00:28.181-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:00:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:00:58.477-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:00:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:01:28.731-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:01:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:01:58.970-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:01:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:02:29.261-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:02:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:02:59.535-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:02:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:03:29.811-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:03:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:04:00.049-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:03:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:04:30.331-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:04:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:05:00.626-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:05:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:05:30.797-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:05:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:06:01.141-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:06:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:06:31.294-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:06:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:07:01.757-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:07:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:07:32.071-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:07:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:08:02.397-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:08:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:08:32.662-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:08:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:09:02.992-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:09:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:09:33.275-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:09:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:10:03.479-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:10:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:10:33.921-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:10:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:11:04.119-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:11:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:11:34.389-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:11:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:12:04.572-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:12:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:12:34.881-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:12:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:13:05.167-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:13:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:13:35.554-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:13:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:14:05.848-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:14:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:14:36.051-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:14:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:15:06.339-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:15:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:15:36.668-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:15:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:16:06.951-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:16:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:16:37.235-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:16:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:17:07.509-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:17:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:17:37.780-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:17:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:18:08.051-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:18:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:18:38.416-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:18:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:19:08.696-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:19:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:19:38.991-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:19:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:20:09.275-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:20:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:20:39.572-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:20:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:21:09.917-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:21:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:21:40.202-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:21:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:22:10.490-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:22:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:22:40.755-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:22:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:23:11.084-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:23:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:23:41.363-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:23:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:24:11.684-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:24:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:24:41.984-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:24:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:25:12.265-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:25:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:25:42.569-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:25:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:26:12.714-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:26:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:26:42.994-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:26:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:27:13.286-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:27:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:27:43.555-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:27:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:28:13.818-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:28:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:28:44.177-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:28:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:29:14.537-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:29:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:29:44.735-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:29:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:30:14.909-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:30:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:30:45.112-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:30:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:31:15.387-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:31:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:31:45.679-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:31:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:32:16.004-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:32:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:32:46.175-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:32:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:33:16.494-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:33:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:33:46.768-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:33:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:34:16.971-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:34:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:34:47.254-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:34:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:35:17.541-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:35:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:35:47.815-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:35:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:36:18.154-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:36:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:36:48.374-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:36:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:37:18.723-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:37:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:37:48.910-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:37:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:38:19.175-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:38:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:38:49.552-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:38:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:39:19.751-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:39:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:39:50.040-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:39:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:40:20.365-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:40:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:40:50.661-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:40:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:41:20.864-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:41:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:41:51.160-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:41:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:42:21.450-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:42:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:42:51.789-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:42:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:43:22.028-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:43:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:43:52.301-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:43:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:44:22.456-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:44:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:44:52.725-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:44:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:45:22.876-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:45:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:45:53.151-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:45:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:46:23.499-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:46:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:46:53.810-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:46:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:47:24.149-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:47:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:47:54.569-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:47:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:48:24.850-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:48:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:48:55.069-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:48:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:49:25.346-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:49:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:49:55.556-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:49:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:50:25.730-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:50:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:50:56.106-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:50:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:51:26.365-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:51:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:51:56.501-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:51:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:52:26.687-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:52:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:52:56.967-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:52:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:53:27.101-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:53:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:53:57.412-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:53:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:54:27.678-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:54:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:54:57.865-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:54:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:55:28.176-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:55:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:55:58.401-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:55:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:56:28.702-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:56:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:56:58.994-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:56:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:57:29.288-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:57:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:57:59.663-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:57:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:58:29.928-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:58:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:59:00.209-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:58:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T16:59:30.590-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 16:59:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:00:00.848-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:00:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:00:31.269-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:00:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:01:01.554-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:01:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:01:31.828-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:01:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:02:01.987-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:02:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:02:32.279-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:02:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:03:02.569-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:03:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:03:32.908-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:03:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:04:03.050-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:04:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:04:33.246-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:04:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:05:03.394-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:05:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:05:33.661-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:05:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:06:04.047-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:06:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:06:34.330-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:06:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:07:04.692-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:07:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:07:35.030-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:07:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:08:05.312-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:08:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:08:35.579-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:08:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:09:05.759-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:09:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:09:36.023-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:09:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:10:06.288-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:10:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:10:36.589-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:10:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:11:06.824-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:11:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:11:36.991-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:11:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:12:07.195-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:12:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:12:37.478-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:12:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:13:07.845-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:13:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:13:38.038-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:13:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:14:08.376-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:14:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:14:38.849-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:14:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:15:09.005-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:15:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:15:39.276-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:15:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:16:09.559-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:16:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:16:39.716-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:16:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:17:09.985-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:17:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:17:40.245-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:17:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:18:10.389-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:18:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:18:40.646-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:18:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:19:10.823-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:19:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:19:41.148-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:19:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:20:11.447-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:20:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:20:41.724-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:20:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:21:11.972-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:21:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:21:42.492-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:21:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:22:12.754-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:22:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:22:42.945-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:22:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:23:13.221-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:23:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:23:43.604-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:23:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:24:13.903-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:24:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:24:44.061-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:24:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:25:14.374-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:25:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:25:44.588-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:25:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:26:15.012-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:26:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:26:45.267-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:26:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:27:15.563-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:27:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:27:45.886-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:27:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:28:16.159-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:28:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:28:46.421-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:28:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:29:16.627-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:29:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:29:46.892-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:29:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:30:17.113-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:30:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:30:47.297-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:30:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:31:17.595-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:31:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:31:47.770-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:31:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:32:18.123-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:32:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:32:48.404-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:32:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:33:18.669-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:33:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:33:48.836-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:33:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:34:19.105-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:34:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:34:49.371-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:34:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:35:19.660-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:35:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:35:49.957-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:35:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:36:20.317-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:36:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:36:50.606-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:36:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:37:20.748-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:37:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:37:51.032-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:37:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:38:21.191-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:38:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:38:51.346-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:38:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:39:21.607-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:39:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:39:51.893-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:39:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:40:22.252-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:40:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:40:52.593-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:40:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:41:22.809-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:41:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:41:53.094-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:41:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:42:23.350-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:42:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:42:53.553-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:42:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:43:23.821-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:43:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:43:54.094-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:43:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:44:24.447-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:44:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:44:54.618-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:44:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:45:24.904-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:45:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:45:55.100-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:45:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:46:25.378-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:46:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:46:55.667-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:46:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:47:25.981-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:47:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:47:56.205-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:47:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:48:26.590-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:48:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:48:56.885-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:48:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:49:27.151-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:49:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:49:57.513-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:49:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:50:27.806-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:50:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:50:58.045-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:50:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:51:28.344-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:51:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:51:58.633-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:51:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:52:28.921-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:52:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:52:59.345-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:52:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:53:29.628-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:53:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:53:59.913-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:53:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:54:30.189-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:54:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:55:00.559-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:55:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:55:30.837-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:55:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:56:01.089-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:56:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:56:31.363-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:56:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:57:01.645-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:57:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:57:32.040-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:57:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:58:02.407-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:58:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:58:32.614-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:58:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:59:03.079-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:59:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T17:59:33.263-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 17:59:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:00:03.450-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:00:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:00:33.745-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:00:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:01:04.085-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:01:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:01:34.458-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:01:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:02:04.634-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:02:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:02:34.953-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:02:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:03:05.146-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:03:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:03:35.327-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:03:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:04:05.590-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:04:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:04:35.944-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:04:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:05:06.115-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:05:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:05:36.278-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:05:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:06:06.441-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:06:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:06:36.854-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:06:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:07:07.140-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:07:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:07:37.470-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:07:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:08:07.792-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:08:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:08:38.063-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:08:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:09:08.209-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:09:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:09:38.527-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:09:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:10:08.819-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:10:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:10:39.037-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:10:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:11:09.199-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:11:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:11:39.477-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:11:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:12:09.753-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:12:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:12:40.025-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:12:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:13:10.280-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:13:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:13:40.592-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:13:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:14:10.888-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:14:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:14:41.160-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:14:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:15:11.522-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:15:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:15:41.897-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:15:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:16:12.168-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:16:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:16:42.467-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:16:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:17:12.760-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:17:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:17:42.948-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:17:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:18:13.142-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:18:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:18:43.440-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:18:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:19:13.746-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:19:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:19:44.033-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:19:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:20:14.318-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:20:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:20:44.592-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:20:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:21:14.859-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:21:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:21:45.086-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:21:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:22:15.340-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:22:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:22:45.688-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:22:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:23:15.944-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:23:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:23:46.236-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:23:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:24:16.542-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:24:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:24:46.779-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:24:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:25:16.946-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:25:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:25:47.235-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:25:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:26:17.531-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:26:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:26:47.727-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:26:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:27:18.012-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:27:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:27:48.292-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:27:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:28:18.578-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:28:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:28:48.884-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:28:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:29:19.282-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:29:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:29:49.551-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:29:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:30:19.880-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:30:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:30:50.144-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:30:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:31:20.302-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:31:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:31:50.563-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:31:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:32:20.840-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:32:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:32:51.062-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:32:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:33:21.301-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:33:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:33:51.701-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:33:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:34:22.001-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:34:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:34:52.340-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:34:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:35:22.551-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:35:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:35:52.932-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:35:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:36:23.212-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:36:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:36:53.499-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:36:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:37:23.790-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:37:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:37:54.079-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:37:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:38:24.513-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:38:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:38:54.750-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:38:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:39:25.043-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:39:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:39:55.304-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:39:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:40:25.496-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:40:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:40:55.789-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:40:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:41:25.947-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:41:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:41:56.089-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:41:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:42:26.395-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:42:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:42:56.691-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:42:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:43:26.839-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:43:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:43:57.061-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:43:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:44:27.349-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:44:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:44:57.635-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:44:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:45:27.789-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:45:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:45:57.974-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:45:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:46:28.228-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:46:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:46:58.622-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:46:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:47:28.783-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:47:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:47:58.974-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:47:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:48:29.254-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:48:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:48:59.531-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:48:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:49:29.823-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:49:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:50:00.077-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:49:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:50:30.361-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:50:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:51:00.515-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:51:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:51:30.936-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:51:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:52:01.211-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:52:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:52:31.386-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:52:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:53:01.529-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:53:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:53:31.810-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:53:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:54:02.183-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:54:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:54:32.342-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:54:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:55:02.616-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:55:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:55:32.941-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:55:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:56:03.237-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:56:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:56:33.533-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:56:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:57:03.679-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:57:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:57:34.028-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:57:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:58:04.380-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:58:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:58:34.783-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:58:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:59:05.118-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:59:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T18:59:35.820-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 18:59:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:00:06.171-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:00:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:00:36.527-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:00:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:01:06.790-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:01:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:01:37.158-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:01:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:02:07.394-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:02:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:02:37.536-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:02:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:03:07.827-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:03:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:03:38.144-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:03:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:04:08.538-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:04:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:04:39.010-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:04:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:05:09.368-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:05:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:05:39.640-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:05:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:06:09.772-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:06:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:06:39.992-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:06:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:07:10.249-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:07:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:07:40.615-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:07:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:08:10.903-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:08:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:08:41.064-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:08:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:09:11.358-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:09:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:09:41.642-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:09:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:10:11.997-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:10:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:10:42.261-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:10:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:11:12.519-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:11:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:11:42.860-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:11:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:12:13.030-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:12:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:12:43.344-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:12:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:13:13.538-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:13:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:13:43.747-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:13:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:14:14.044-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:14:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:14:44.376-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:14:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:15:14.684-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:15:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:15:44.842-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:15:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:16:14.988-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:16:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:16:45.247-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:16:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:17:15.540-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:17:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:17:45.894-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:17:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:18:16.185-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:18:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:18:46.528-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:18:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:19:16.828-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:19:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:19:47.090-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:19:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:20:17.317-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:20:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:20:47.459-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:20:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:21:17.702-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:21:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:21:48.039-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:21:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:22:18.306-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:22:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:22:48.674-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:22:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:23:18.963-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:23:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:23:49.250-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:23:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:24:19.420-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:24:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:24:49.765-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:24:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:25:20.050-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:25:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:25:50.207-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:25:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:26:20.596-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:26:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:26:50.831-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:26:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:27:21.110-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:27:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:27:51.401-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:27:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:28:21.539-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:28:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:28:51.830-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:28:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:29:22.191-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:29:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:29:52.432-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:29:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:30:22.769-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:30:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:30:53.148-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:30:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:31:23.352-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:31:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:31:53.624-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:31:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:32:23.908-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:32:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:32:54.214-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:32:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:33:24.633-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:33:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:33:54.990-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:33:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:34:25.320-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:34:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:34:55.617-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:34:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:35:25.897-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:35:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:35:56.217-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:35:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:36:26.346-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:36:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:36:56.635-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:36:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:37:27.020-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:37:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:37:57.325-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:37:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:38:27.595-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:38:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:38:57.959-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:38:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:39:28.215-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:39:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:39:58.481-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:39:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:40:28.625-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:40:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:40:58.926-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:40:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:41:29.200-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:41:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:41:59.397-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:41:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:42:29.712-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:42:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:42:59.896-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:42:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:43:30.183-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:43:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:44:00.458-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:44:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:44:30.752-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:44:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:45:01.049-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:45:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:45:31.356-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:45:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:46:01.557-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:46:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:46:31.748-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:46:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:47:02.024-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:47:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:47:32.322-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:47:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:48:02.508-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:48:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:48:32.805-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:48:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:49:03.065-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:49:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:49:33.394-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:49:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:50:03.700-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:50:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:50:33.845-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:50:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:51:04.108-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:51:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:51:34.352-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:51:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:52:04.648-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:52:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:52:34.933-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:52:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:53:05.208-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:53:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:53:35.486-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:53:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:54:05.757-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:54:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:54:36.035-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:54:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:55:06.221-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:55:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:55:36.423-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:55:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:56:06.844-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:56:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:56:37.114-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:56:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:57:07.380-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:57:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:57:37.703-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:57:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:58:07.999-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:58:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:58:38.271-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:58:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:59:08.531-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:59:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T19:59:38.814-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 19:59:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:00:09.098-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:00:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:00:39.244-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:00:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:01:09.524-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:01:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:01:39.731-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:01:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:02:09.957-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:02:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:02:40.268-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:02:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:03:10.531-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:03:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:03:40.764-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:03:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:04:11.027-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:04:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:04:41.438-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:04:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:05:11.836-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:05:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:05:42.147-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:05:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:06:12.389-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:06:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:06:42.707-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:06:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:07:13.024-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:07:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:07:43.316-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:07:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:08:13.591-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:08:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:08:43.805-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:08:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:09:14.094-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:09:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:09:44.380-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:09:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:10:14.667-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:10:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:10:44.924-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:10:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:11:15.295-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:11:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:11:45.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:11:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:12:15.843-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:12:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:12:46.145-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:12:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:13:16.318-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:13:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:13:46.622-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:13:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:14:16.908-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:14:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:14:47.214-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:14:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:15:17.450-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:15:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:15:47.739-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:15:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:16:18.035-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:16:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:16:48.295-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:16:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:17:18.570-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:17:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:17:48.791-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:17:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:18:18.935-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:18:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:18:49.112-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:18:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:19:19.299-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:19:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:19:49.541-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:19:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:20:19.767-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:20:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:20:50.187-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:20:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:21:20.411-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:21:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:21:50.704-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:21:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:22:21.001-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:22:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:22:51.294-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:22:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:23:21.640-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:23:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:23:51.913-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:23:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:24:22.203-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:24:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:24:52.500-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:24:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:25:22.787-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:25:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:25:52.942-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:25:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:26:23.233-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:26:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:26:53.509-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:26:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:27:23.816-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:27:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:27:54.125-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:27:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:28:24.435-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:28:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:28:54.699-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:28:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:29:24.981-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:29:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:29:55.125-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:29:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:30:25.408-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:30:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:30:55.704-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:30:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:31:26.058-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:31:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:31:56.327-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:31:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:32:26.613-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:32:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:32:56.755-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:32:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:33:27.148-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:33:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:33:57.588-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:33:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:34:27.844-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:34:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:34:58.163-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:34:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:35:28.458-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:35:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:35:58.852-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:35:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:36:29.199-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:36:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:36:59.579-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:36:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:37:29.807-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:37:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:38:00.109-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:37:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:38:30.399-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:38:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:39:00.763-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:39:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:39:31.033-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:39:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:40:01.301-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:40:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:40:31.590-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:40:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:41:01.760-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:41:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:41:32.037-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:41:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:42:02.444-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:42:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:42:32.734-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:42:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:43:02.966-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:43:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:43:33.240-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:43:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:44:03.510-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:44:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:44:33.795-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:44:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:45:04.081-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:45:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:45:34.411-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:45:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:46:04.577-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:46:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:46:34.936-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:46:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:47:05.221-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:47:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:47:35.474-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:47:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:48:05.660-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:48:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:48:35.852-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:48:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:49:06.096-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:49:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:49:36.469-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:49:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:50:06.795-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:50:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:50:37.069-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:50:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:51:07.360-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:51:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:51:37.740-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:51:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:52:08.035-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:52:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:52:38.230-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:52:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:53:08.424-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:53:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:53:38.722-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:53:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:54:09.065-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:54:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:54:39.392-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:54:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:55:09.720-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:55:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:55:39.875-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:55:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:56:10.329-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:56:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:56:40.657-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:56:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:57:10.794-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:57:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:57:41.053-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:57:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:58:11.218-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:58:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:58:41.419-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:58:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:59:11.699-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:59:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T20:59:41.878-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 20:59:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:00:12.119-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:00:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:00:42.382-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:00:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:01:12.736-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:01:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:01:43.008-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:01:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:02:13.306-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:02:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:02:43.581-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:02:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:03:13.865-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:03:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:03:44.174-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:03:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:04:14.413-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:04:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:04:44.798-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:04:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:05:15.177-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:05:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:05:45.450-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:05:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:06:15.609-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:06:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:06:46.079-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:06:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:07:16.383-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:07:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:07:46.642-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:07:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:08:16.883-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:08:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:08:47.287-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:08:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:09:17.601-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:09:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:09:47.927-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:09:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:10:18.199-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:10:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:10:48.560-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:10:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:11:18.847-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:11:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:11:49.030-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:11:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:12:19.242-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:12:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:12:49.514-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:12:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:13:19.782-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:13:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:13:49.959-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:13:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:14:20.286-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:14:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:14:50.595-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:14:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:15:20.875-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:15:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:15:51.142-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:15:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:16:21.651-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:16:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:16:51.911-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:16:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:17:22.183-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:17:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:17:52.321-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:17:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:18:22.512-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:18:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:18:52.670-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:18:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:19:23.022-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:19:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:19:53.166-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:19:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:20:23.304-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:20:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:20:53.603-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:20:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:21:23.887-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:21:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:21:54.056-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:21:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:22:24.350-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:22:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:22:54.570-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:22:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:23:24.697-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:23:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:23:54.844-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:23:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:24:25.024-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:24:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:24:55.301-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:24:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:25:25.471-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:25:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:25:55.772-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:25:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:26:26.051-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:26:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:26:56.332-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:26:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:27:26.597-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:27:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:27:56.863-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:27:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:28:27.089-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:28:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:28:57.375-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:28:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:29:27.730-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:29:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:29:58.022-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:29:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:30:28.237-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:30:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:30:58.524-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:30:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:31:28.896-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:31:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:31:59.068-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:31:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:32:29.247-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:32:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:32:59.452-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:32:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:33:29.659-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:33:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:33:59.901-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:33:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:34:30.210-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:34:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:35:00.492-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:35:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:35:30.758-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:35:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:36:01.041-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:36:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:36:31.350-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:36:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:37:01.595-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:37:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:37:31.883-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:37:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:38:02.175-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:38:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:38:32.360-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:38:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:39:02.750-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:39:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:39:33.036-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:39:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:40:03.186-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:40:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:40:33.407-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:40:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:41:03.629-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:41:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:41:33.972-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:41:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:42:04.167-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:42:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:42:34.549-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:42:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:43:04.732-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:43:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:43:35.063-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:43:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:44:05.279-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:44:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:44:35.680-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:44:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:45:05.826-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:45:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:45:36.107-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:45:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:46:06.390-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:46:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:46:36.775-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:46:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:47:06.980-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:47:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:47:37.282-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:47:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:48:07.447-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:48:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:48:37.749-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:48:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:49:07.903-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:49:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:49:38.211-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:49:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:50:08.580-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:50:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:50:38.848-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:50:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:51:09.237-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:51:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:51:39.602-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:51:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:52:09.782-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:52:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:52:40.109-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:52:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:53:10.384-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:53:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:53:40.722-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:53:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:54:11.009-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:54:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:54:41.304-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:54:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:55:11.540-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:55:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:55:41.890-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:55:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:56:12.187-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:56:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:56:42.487-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:56:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:57:12.791-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:57:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:57:43.040-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:57:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:58:13.390-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:58:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:58:43.686-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:58:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:59:13.990-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:59:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T21:59:44.380-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 21:59:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:00:14.654-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:00:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:00:44.866-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:00:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:01:15.034-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:01:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:01:45.410-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:01:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:02:15.751-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:02:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:02:46.031-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:02:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:03:16.302-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:03:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:03:46.644-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:03:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:04:16.865-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:04:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:04:47.147-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:04:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:05:17.433-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:05:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:05:47.720-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:05:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:06:18.076-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:06:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:06:48.296-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:06:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:07:18.597-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:07:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:07:48.880-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:07:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:08:19.158-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:08:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:08:49.463-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:08:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:09:19.743-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:09:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:09:50.040-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:09:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:10:20.310-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:10:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:10:50.611-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:10:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:11:21.011-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:11:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:11:51.286-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:11:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:12:21.427-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:12:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:12:51.693-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:12:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:13:21.880-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:13:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:13:52.213-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:13:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:14:22.472-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:14:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:14:52.762-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:14:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:15:23.255-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:15:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:15:53.588-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:15:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:16:23.913-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:16:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:16:54.181-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:16:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:17:24.451-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:17:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:17:54.633-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:17:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:18:24.910-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:18:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:18:55.252-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:18:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:19:25.520-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:19:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:19:55.825-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:19:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:20:26.180-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:20:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:20:56.392-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:20:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:21:26.592-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:21:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:21:56.891-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:21:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:22:27.085-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:22:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:22:57.387-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:22:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:23:27.608-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:23:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:23:58.035-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:23:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:24:28.314-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:24:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:24:58.640-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:24:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:25:28.788-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:25:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:25:58.937-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:25:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:26:29.214-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:26:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:26:59.426-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:26:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:27:29.703-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:27:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:28:00.110-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:27:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:28:30.293-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:28:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:29:00.485-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:29:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:29:30.627-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:29:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:30:00.917-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:30:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:30:31.203-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:30:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:31:01.379-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:31:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:31:31.658-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:31:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:32:01.946-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:32:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:32:32.222-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:32:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:33:02.451-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:33:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:33:32.742-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:33:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:34:03.100-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:34:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:34:33.398-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:34:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:35:03.578-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:35:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:35:33.962-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:35:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:36:04.220-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:36:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:36:34.502-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:36:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:37:04.733-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:37:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:37:35.009-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:37:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:38:05.273-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:38:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:38:35.619-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:38:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:39:05.969-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:39:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:39:36.222-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:39:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:40:06.482-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:40:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:40:36.632-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:40:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:41:06.885-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:41:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:41:37.136-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:41:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:42:07.415-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:42:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:42:37.611-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:42:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:43:07.920-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:43:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:43:38.083-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:43:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:44:08.237-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:44:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:44:38.508-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:44:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:45:08.650-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:45:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:45:38.929-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:45:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:46:09.251-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:46:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:46:39.595-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:46:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:47:09.775-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:47:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:47:40.051-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:47:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:48:10.239-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:48:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:48:40.502-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:48:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:49:10.766-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:49:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:49:41.074-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:49:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:50:11.391-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:50:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:50:41.537-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:50:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:51:11.895-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:51:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:51:42.059-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:51:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:52:12.258-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:52:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:52:42.649-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:52:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:53:12.919-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:53:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:53:43.197-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:53:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:54:13.490-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:54:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:54:43.752-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:54:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:55:14.008-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:55:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:55:44.311-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:55:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:56:14.601-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:56:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:56:44.836-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:56:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:57:15.005-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:57:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:57:45.429-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:57:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:58:15.613-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:58:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:58:45.945-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:58:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:59:16.130-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:59:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T22:59:46.403-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 22:59:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:00:16.658-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:00:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:00:46.958-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:00:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:01:17.151-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:01:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:01:47.425-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:01:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:02:17.732-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:02:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:02:48.023-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:02:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:03:18.181-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:03:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:03:48.454-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:03:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:04:18.744-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:04:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:04:48.950-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:04:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:05:19.175-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:05:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:05:49.394-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:05:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:06:19.619-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:06:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:06:49.843-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:06:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:07:20.082-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:07:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:07:50.239-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:07:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:08:20.552-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:08:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:08:51.011-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:08:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:09:21.302-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:09:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:09:51.571-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:09:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:10:21.898-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:10:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:10:52.163-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:10:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:11:22.426-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:11:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:11:52.602-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:11:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:12:22.864-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:12:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:12:53.144-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:12:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:13:23.407-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:13:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:13:53.870-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:13:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:14:24.166-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:14:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:14:54.439-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:14:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:15:24.737-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:15:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:15:54.921-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:15:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:16:25.170-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:16:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:16:55.452-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:16:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:17:25.749-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:17:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:17:56.069-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:17:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:18:26.318-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:18:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:18:56.610-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:18:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:19:27.005-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:19:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:19:57.259-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:19:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:20:27.424-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:20:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:20:57.702-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:20:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:21:27.969-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:21:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:21:58.267-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:21:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:22:28.561-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:22:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:22:58.739-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:22:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:23:29.014-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:23:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:23:59.333-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:23:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:24:29.598-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:24:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:24:59.941-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:24:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:25:30.100-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:25:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:26:00.255-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:26:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:26:30.516-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:26:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:27:00.801-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:27:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:27:31.067-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:27:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:28:01.344-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:28:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:28:31.546-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:28:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:29:01.703-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:29:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:29:31.976-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:29:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:30:02.124-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:30:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:30:32.410-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:30:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:31:02.583-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:31:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:31:32.952-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:31:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:32:03.146-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:32:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:32:33.400-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:32:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:33:03.672-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:33:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:33:33.933-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:33:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:34:04.217-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:34:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:34:34.559-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:34:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:35:04.703-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:35:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:35:35.064-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:35:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:36:05.326-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:36:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:36:35.627-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:36:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:37:05.904-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:37:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:37:36.181-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:37:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:38:06.339-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:38:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:38:36.625-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:38:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:39:06.910-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:39:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:39:37.197-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:39:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:40:07.472-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:40:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:40:37.759-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:40:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:41:08.041-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:41:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:41:38.313-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:41:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:42:08.711-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:42:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:42:38.951-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:42:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:43:09.227-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:43:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:43:39.677-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:43:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:44:09.862-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:44:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:44:40.130-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:44:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:45:10.441-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:45:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:45:40.720-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:45:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:46:11.035-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:46:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:46:41.263-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:46:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:47:11.443-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:47:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:47:41.732-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:47:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:48:11.900-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:48:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:48:42.125-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:48:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:49:12.404-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:49:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:49:42.684-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:49:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:50:12.870-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:50:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:50:43.117-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:50:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:51:13.418-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:51:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:51:43.753-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:51:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:52:14.055-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:52:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:52:44.292-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:52:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:53:14.570-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:53:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:53:44.795-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:53:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:54:15.014-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:54:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:54:45.142-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:54:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:55:15.553-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:55:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:55:45.699-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:55:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:56:15.853-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:56:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:56:45.986-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:56:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:57:16.269-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:57:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:57:46.586-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:57:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:58:16.866-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:58:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:58:47.164-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:58:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:59:17.441-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:59:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-21T23:59:47.782-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 21 23:59:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:00:18.061-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:00:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:00:47.980-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:00:47.980-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:00:48.363-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:00:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:01:18.555-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:01:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:01:48.701-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:01:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:02:18.980-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:02:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:02:19.164-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:02:19.164-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:02:49.251-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:02:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:02:55.796-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58843cff9527cdec667c0dd7 2017-01-22T00:02:56.363-0500 [Balancer] ChunkManager: time to load chunks for historyDb.History: 113ms sequenceNumber: 3 version: 3272|51||55c0dbaf5b591f0b0cfcee5f based on: 3272|39||55c0dbaf5b591f0b0cfcee5f 2017-01-22T00:02:56.569-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T00:03:19.619-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:03:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:03:49.908-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:03:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:04:20.194-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:04:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:04:45.843-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:04:45.843-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:04:50.622-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:04:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:05:20.909-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:05:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:05:51.246-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:05:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:06:17.372-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:06:17.372-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:06:21.532-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:06:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:06:23.501-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:06:23.501-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:06:51.887-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:06:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:07:00.127-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:07:00.127-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:07:22.183-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:07:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:07:52.503-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:07:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:08:22.794-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:08:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:08:31.552-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:08:31.553-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:08:53.079-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:08:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:09:08.074-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:09:08.075-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:09:23.372-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:09:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:09:38.600-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:09:38.601-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:09:53.540-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:09:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:10:23.814-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:10:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:10:54.138-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:10:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:11:24.431-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:11:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:11:54.705-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:11:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:12:16.678-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:12:16.678-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:12:24.875-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:12:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:12:55.074-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:12:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:13:25.335-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:13:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:13:55.477-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:13:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:14:00.119-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:14:00.119-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:14:12.375-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:14:12.376-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:14:18.589-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:14:18.589-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:14:24.830-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:14:24.830-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:14:25.828-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:14:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:14:31.050-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:14:31.051-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:14:55.582-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58843fcf9527cdec667c0de5 2017-01-22T00:14:56.125-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:14:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:14:56.161-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T00:15:26.414-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:15:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:15:26.849-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:15:26.849-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:15:56.713-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:15:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:15:57.462-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:15:57.463-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:16:26.996-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:16:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:16:57.282-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:16:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:17:04.236-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:17:04.236-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:17:16.637-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:17:16.637-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:17:27.576-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:17:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:17:53.186-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:17:53.187-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:17:57.816-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:17:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:17:59.359-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:17:59.360-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:18:28.020-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:18:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:18:30.048-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588440a59527cdec667c0dec 2017-01-22T00:18:30.610-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T00:18:55.155-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588440be9527cdec667c0ded 2017-01-22T00:18:55.865-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T00:18:58.300-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:18:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:19:08.301-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588440cc9527cdec667c0dee 2017-01-22T00:19:08.970-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T00:19:28.572-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:19:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:19:33.564-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588440e59527cdec667c0def 2017-01-22T00:19:34.275-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T00:19:40.738-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588440ec9527cdec667c0df0 2017-01-22T00:19:41.407-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T00:19:47.762-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588440f39527cdec667c0df1 2017-01-22T00:19:48.431-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T00:19:58.849-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:19:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:20:29.133-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:20:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:20:59.642-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:20:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:21:30.138-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:21:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:21:56.324-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588441749527cdec667c0df2 2017-01-22T00:21:56.967-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T00:22:00.409-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:22:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:22:03.282-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5884417b9527cdec667c0df3 2017-01-22T00:22:04.082-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T00:22:30.666-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:22:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:22:46.726-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588441a69527cdec667c0df4 2017-01-22T00:22:47.295-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T00:23:00.978-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:23:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:23:17.902-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588441c59527cdec667c0df5 2017-01-22T00:23:18.602-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T00:23:31.231-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:23:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:23:49.184-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:23:49.184-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:24:01.540-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:24:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:24:19.717-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:24:19.717-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:24:31.751-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:24:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:25:02.086-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:25:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:25:32.274-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:25:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:26:02.489-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:26:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:26:32.746-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:26:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:27:03.134-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:27:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:27:33.403-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:27:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:27:40.013-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:27:40.013-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:28:03.661-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:28:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:28:33.942-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:28:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:29:04.103-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:29:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:29:29.478-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:29:29.478-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:29:34.389-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:29:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:29:47.820-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:29:47.821-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:29:54.009-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:29:54.009-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:30:04.682-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:30:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:30:34.970-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:30:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:30:42.827-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:30:42.827-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:31:05.133-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:31:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:31:07.306-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:31:07.306-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:31:35.438-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:31:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:31:38.031-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588443b99527cdec667c0dfe 2017-01-22T00:31:38.593-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T00:31:57.039-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588443cc9527cdec667c0dff 2017-01-22T00:31:57.633-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T00:32:05.675-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:32:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:32:35.983-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:32:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:32:46.463-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588443fe9527cdec667c0e00 2017-01-22T00:32:47.034-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T00:33:06.239-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:33:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:33:11.561-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588444179527cdec667c0e01 2017-01-22T00:33:12.122-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T00:33:36.479-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:33:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:33:36.655-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:33:36.655-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:34:06.658-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:34:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:34:13.443-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588444559527cdec667c0e03 2017-01-22T00:34:14.085-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T00:34:20.441-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:34:20.441-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:34:36.817-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:34:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:35:07.061-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:35:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:35:09.079-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:35:09.079-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:35:37.331-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:35:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:36:07.610-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:36:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:36:22.262-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588444d59527cdec667c0e06 2017-01-22T00:36:23.049-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T00:36:37.862-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:36:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:37:05.657-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:37:05.657-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:37:08.141-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:37:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:37:38.610-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:37:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:38:08.923-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:38:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:38:39.199-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:38:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:38:43.113-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:38:43.113-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:39:01.525-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('58844574265bddce1ba14e3c') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485063541450), why: "doing balance round", ts: ObjectId('588445759527cdec667c0e09') } } gle1: { lastOp: Timestamp 1485063382000|54, connectionId: 21778, updatedExisting: false, n: 0, syncMillis: 5, writtenTo: null, err: null, waited: 5, ok: 1.0 } gle2: { lastOp: Timestamp 1485063541000|21, connectionId: 6379656, updatedExisting: true, n: 1, syncMillis: 5, writtenTo: null, err: null, waited: 5, ok: 1.0 } 2017-01-22T00:39:01.532-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-22T00:39:01.532-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:39:07.731-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:39:07.731-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:39:09.503-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:39:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:39:09.503-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-22T00:39:09.645-0500 [LockPinger] handled late remove of old distributed lock with ts 588445759527cdec667c0e09 2017-01-22T00:39:19.999-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:39:20.000-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:39:26.211-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:39:26.212-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:39:40.039-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:39:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:39:56.861-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:39:56.861-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:40:09.126-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:40:09.126-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:40:10.295-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:40:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:40:33.614-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:40:33.614-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:40:40.578-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:40:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:40:52.017-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:40:52.017-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:40:58.169-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:40:58.170-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:41:10.496-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:41:10.496-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:41:10.880-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:41:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:41:41.141-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:41:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:42:11.424-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:42:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:42:41.694-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:42:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:43:12.001-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:43:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:43:42.288-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:43:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:44:12.641-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:44:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:44:12.644-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:44:12.644-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:44:42.911-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:44:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:44:49.117-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:44:49.117-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:45:01.391-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:45:01.391-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:45:13.196-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:45:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:45:31.909-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:45:31.909-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:45:43.458-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:45:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:45:44.174-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:45:44.174-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:46:13.752-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:46:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:46:26.888-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:46:26.888-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:46:43.955-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:46:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:47:14.228-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:47:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:47:44.532-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:47:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:48:14.787-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:48:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:48:16.326-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588447a09527cdec667c0e19 2017-01-22T00:48:16.924-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T00:48:29.195-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:48:29.195-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:48:41.617-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588447b99527cdec667c0e1b 2017-01-22T00:48:42.258-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T00:48:45.086-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:48:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:49:15.508-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:49:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:49:45.787-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:49:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:50:01.717-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:50:01.717-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:50:16.095-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:50:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:50:46.295-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:50:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:51:16.681-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:51:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:51:46.832-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:51:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:52:17.123-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:52:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:52:47.458-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:52:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:53:04.199-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:53:04.199-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:53:17.787-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:53:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:53:48.108-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:53:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:53:58.985-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588448f69527cdec667c0e1e 2017-01-22T00:53:59.628-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T00:54:05.972-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588448fd9527cdec667c0e1f 2017-01-22T00:54:06.638-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T00:54:18.375-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:54:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:54:25.172-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588449109527cdec667c0e20 2017-01-22T00:54:25.844-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T00:54:32.145-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588449179527cdec667c0e21 2017-01-22T00:54:32.813-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T00:54:45.139-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:54:45.139-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:54:48.694-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:54:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:54:51.354-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:54:51.354-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:55:19.152-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:55:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:55:46.092-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T00:55:46.092-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:55:49.489-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:55:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:56:19.756-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:56:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:56:49.915-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:56:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:57:20.182-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:57:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:57:50.468-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:57:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:57:53.663-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588449e19527cdec667c0e25 2017-01-22T00:57:54.190-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T00:58:12.653-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588449f49527cdec667c0e26 2017-01-22T00:58:13.325-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T00:58:20.847-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:58:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:58:43.723-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('58844a1207880d6ccb6cacbd') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485064723656), why: "doing balance round", ts: ObjectId('58844a139527cdec667c0e27') } } gle1: { lastOp: Timestamp 1485064723000|13, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 13, writtenTo: null, err: null, waited: 13, ok: 1.0 } gle2: { lastOp: Timestamp 1485064693000|4, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 1, writtenTo: null, err: null, waited: 1, ok: 1.0 } 2017-01-22T00:58:43.741-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-22T00:58:43.741-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T00:58:50.998-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:58:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:58:50.998-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-22T00:58:51.070-0500 [LockPinger] handled late remove of old distributed lock with ts 58844a139527cdec667c0e27 2017-01-22T00:59:21.360-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:59:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T00:59:32.466-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58844a449527cdec667c0e28 2017-01-22T00:59:33.137-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T00:59:51.536-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 00:59:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:00:03.774-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:00:03.774-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:00:16.103-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:00:16.103-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:00:21.744-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:00:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:00:51.999-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:00:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:01:22.169-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:01:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:01:29.010-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:01:29.010-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:01:41.250-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:01:41.250-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:01:52.374-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:01:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:01:53.689-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:01:53.689-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:02:18.430-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58844aea9527cdec667c0e2e 2017-01-22T01:02:19.094-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T01:02:22.651-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:02:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:02:25.338-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58844af19527cdec667c0e2f 2017-01-22T01:02:26.057-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T01:02:38.455-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58844afe9527cdec667c0e30 2017-01-22T01:02:39.020-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T01:02:52.910-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:02:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:03:09.708-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:03:09.709-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:03:22.115-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58844b299527cdec667c0e32 2017-01-22T01:03:22.868-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T01:03:23.224-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:03:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:03:53.564-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:03:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:04:17.582-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58844b619527cdec667c0e33 2017-01-22T01:04:18.159-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T01:04:23.853-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:04:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:04:42.724-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58844b7a9527cdec667c0e34 2017-01-22T01:04:43.392-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T01:04:54.213-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:04:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:05:24.583-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:05:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:05:44.650-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:05:44.650-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:05:54.877-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:05:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:06:03.038-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:06:03.038-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:06:21.523-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58844bdd9527cdec667c0e37 2017-01-22T01:06:22.121-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T01:06:25.073-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:06:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:06:55.255-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:06:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:07:05.027-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58844c089527cdec667c0e38 2017-01-22T01:07:05.621-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T01:07:11.948-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58844c0f9527cdec667c0e39 2017-01-22T01:07:12.651-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T01:07:25.496-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:07:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:07:55.679-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:07:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:08:13.461-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:08:13.461-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:08:25.962-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:08:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:08:56.268-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:08:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:08:56.271-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58844c779527cdec667c0e3b 2017-01-22T01:08:56.763-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T01:09:26.570-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:09:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:09:27.245-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:09:27.246-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:09:56.819-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:09:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:10:27.154-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:10:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:10:57.431-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:10:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:11:27.696-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:11:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:11:35.063-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58844d169527cdec667c0e3d 2017-01-22T01:11:35.723-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T01:11:41.965-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58844d1d9527cdec667c0e3e 2017-01-22T01:11:42.612-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T01:11:54.892-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:11:54.892-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:11:57.970-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:11:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:12:28.148-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:12:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:12:31.486-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('58844d4e30bb6f0e9a292509') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485065551319), why: "doing balance round", ts: ObjectId('58844d4f9527cdec667c0e40') } } gle1: { lastOp: Timestamp 1485065551000|10, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 7, writtenTo: null, err: null, waited: 7, ok: 1.0 } gle2: { lastOp: Timestamp 1485065502000|20, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 27, writtenTo: null, err: null, waited: 27, ok: 1.0 } 2017-01-22T01:12:31.495-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-22T01:12:31.668-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58844d4f9527cdec667c0e40 2017-01-22T01:12:32.302-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T01:12:38.769-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58844d569527cdec667c0e41 2017-01-22T01:12:39.471-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T01:12:58.435-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:12:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:13:28.218-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:13:28.218-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:13:28.709-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:13:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:13:59.087-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:13:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:14:29.244-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:14:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:14:35.163-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:14:35.163-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:14:59.548-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:14:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:15:11.759-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:15:11.759-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:15:17.975-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:15:17.975-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:15:29.808-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:15:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:16:00.096-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:15:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:16:30.391-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:16:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:16:43.060-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:16:43.060-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:16:55.351-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:16:55.352-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:17:00.726-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:17:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:17:30.990-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:17:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:17:56.266-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:17:56.267-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:18:01.196-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:18:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:18:31.526-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:18:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:18:45.019-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:18:45.019-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:19:01.827-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:19:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:19:15.485-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:19:15.485-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:19:27.969-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58844eef9527cdec667c0e4b 2017-01-22T01:19:28.568-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T01:19:32.111-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:19:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:20:02.470-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:20:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:20:32.618-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:20:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:20:59.952-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58844f4b9527cdec667c0e4c 2017-01-22T01:21:00.658-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T01:21:02.899-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:21:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:21:07.123-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58844f529527cdec667c0e4d 2017-01-22T01:21:07.755-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T01:21:33.238-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:21:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:22:03.523-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:22:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:22:33.944-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:22:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:22:51.101-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:22:51.101-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:23:04.214-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:23:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:23:09.422-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:23:09.422-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:23:34.380-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:23:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:23:58.043-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:23:58.043-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:24:04.618-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:24:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:24:10.455-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5884500a9527cdec667c0e51 2017-01-22T01:24:11.056-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T01:24:17.364-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588450119527cdec667c0e52 2017-01-22T01:24:18.068-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T01:24:34.798-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:24:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:24:42.653-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:24:42.653-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:24:48.878-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:24:48.879-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:25:05.088-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:25:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:25:35.254-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:25:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:25:37.621-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:25:37.621-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:25:49.878-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:25:49.879-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:26:05.687-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:26:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:26:36.113-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:26:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:26:38.920-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5884509e9527cdec667c0e57 2017-01-22T01:26:39.574-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T01:27:06.282-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:27:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:27:36.574-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:27:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:27:52.730-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:27:52.730-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:28:06.840-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:28:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:28:37.155-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:28:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:28:47.939-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5884511f9527cdec667c0e59 2017-01-22T01:28:48.549-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T01:29:07.350-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:29:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:29:37.602-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:29:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:30:07.860-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:30:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:30:26.025-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:30:26.025-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:30:32.312-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588451889527cdec667c0e5b 2017-01-22T01:30:33.125-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T01:30:38.162-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:30:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:31:08.457-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:31:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:31:15.743-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588451b2f25088d9cc6d14e6') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485066675616), why: "doing balance round", ts: ObjectId('588451b39527cdec667c0e5c') } } gle1: { lastOp: Timestamp 1485066675000|25, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 28, writtenTo: null, err: null, waited: 28, ok: 1.0 } gle2: { lastOp: Timestamp 1485066633000|3, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 27, writtenTo: null, err: null, waited: 27, ok: 1.0 } 2017-01-22T01:31:15.749-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-22T01:31:15.749-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:31:38.753-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:31:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:31:38.753-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-22T01:31:38.893-0500 [LockPinger] handled late remove of old distributed lock with ts 588451b39527cdec667c0e5c 2017-01-22T01:31:46.175-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:31:46.175-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:32:04.443-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:32:04.443-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:32:09.185-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:32:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:32:16.709-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:32:16.709-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:32:28.918-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:32:28.918-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:32:39.466-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:32:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:33:05.547-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:33:05.547-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:33:09.756-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:33:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:33:23.890-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588452339527cdec667c0e62 2017-01-22T01:33:24.475-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T01:33:39.961-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:33:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:33:49.014-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5884524c9527cdec667c0e63 2017-01-22T01:33:49.606-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T01:34:10.215-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:34:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:34:40.556-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:34:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:34:56.615-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588452909527cdec667c0e64 2017-01-22T01:34:57.358-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T01:35:09.777-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5884529d9527cdec667c0e65 2017-01-22T01:35:10.414-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T01:35:10.704-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:35:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:35:40.969-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:35:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:36:11.240-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:36:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:36:17.375-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588452e099f0e04f44efcafe') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485066977253), why: "doing balance round", ts: ObjectId('588452e19527cdec667c0e66') } } gle1: { lastOp: Timestamp 1485066910000|20, connectionId: 21778, updatedExisting: false, n: 0, syncMillis: 30, writtenTo: null, err: null, waited: 30, ok: 1.0 } gle2: { lastOp: Timestamp 1485066977000|8, connectionId: 393608, updatedExisting: true, n: 1, syncMillis: 15, writtenTo: null, err: null, waited: 15, ok: 1.0 } 2017-01-22T01:36:17.380-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-22T01:36:17.380-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:36:29.693-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:36:29.693-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:36:41.588-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:36:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:36:41.588-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-22T01:36:41.733-0500 [LockPinger] handled late remove of old distributed lock with ts 588452e19527cdec667c0e66 2017-01-22T01:36:41.997-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:36:41.997-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:37:12.123-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:37:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:37:12.455-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5884531799f0e04f44efcaff') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485067032320), why: "doing balance round", ts: ObjectId('588453189527cdec667c0e69') } } gle1: { lastOp: Timestamp 1485066910000|20, connectionId: 21778, updatedExisting: false, n: 0, syncMillis: 21, writtenTo: null, err: null, waited: 21, ok: 1.0 } gle2: { lastOp: Timestamp 1485067032000|30, connectionId: 6379656, updatedExisting: true, n: 1, syncMillis: 3, writtenTo: null, err: null, waited: 3, ok: 1.0 } 2017-01-22T01:37:12.464-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-22T01:37:12.464-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:37:24.765-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:37:24.766-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:37:42.443-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:37:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:37:42.443-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-22T01:37:42.592-0500 [LockPinger] handled late remove of old distributed lock with ts 588453189527cdec667c0e69 2017-01-22T01:38:12.916-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:38:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:38:43.203-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:38:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:38:50.174-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:38:50.175-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:39:13.403-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:39:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:39:43.676-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:39:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:40:09.539-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:40:09.539-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:40:13.959-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:40:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:40:44.178-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:40:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:40:58.504-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:40:58.505-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:41:14.464-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:41:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:41:16.881-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:41:16.881-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:41:44.712-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:41:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:42:15.002-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:42:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:42:30.048-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:42:30.049-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:42:45.266-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:42:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:42:54.498-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:42:54.498-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:43:15.510-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:43:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:43:45.797-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:43:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:43:49.481-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588454a59527cdec667c0e71 2017-01-22T01:43:50.050-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T01:44:14.729-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588454be9527cdec667c0e72 2017-01-22T01:44:15.442-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T01:44:16.118-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:44:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:44:21.760-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588454c59527cdec667c0e73 2017-01-22T01:44:22.419-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T01:44:46.388-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:44:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:44:46.890-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588454de9527cdec667c0e74 2017-01-22T01:44:47.527-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T01:45:16.673-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:45:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:45:17.925-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:45:17.926-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:45:46.946-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:45:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:45:55.000-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:45:55.000-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:46:01.345-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:46:01.345-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:46:17.227-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:46:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:46:47.426-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:46:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:47:02.196-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:47:02.197-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:47:08.470-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:47:08.470-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:47:17.722-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:47:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:47:45.192-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588455909527cdec667c0e7a 2017-01-22T01:47:45.823-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T01:47:48.040-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:47:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:48:10.341-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588455aa9527cdec667c0e7b 2017-01-22T01:48:10.968-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T01:48:18.402-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:48:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:48:48.708-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:48:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:49:18.963-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:49:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:49:49.233-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:49:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:50:12.454-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:50:12.454-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:50:19.522-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:50:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:50:49.877-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:50:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:51:07.213-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:51:07.213-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:51:20.178-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:51:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:51:50.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:51:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:52:20.708-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:52:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:52:44.485-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:52:44.485-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:52:51.111-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:52:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:53:21.303-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588456e0b7196b1705143405') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485068001171), why: "doing balance round", ts: ObjectId('588456e19527cdec667c0e7f') } } gle1: { lastOp: Timestamp 1485067690000|37, connectionId: 21778, updatedExisting: false, n: 0, syncMillis: 24, writtenTo: null, err: null, waited: 24, ok: 1.0 } gle2: { lastOp: Timestamp 1485068001000|8, connectionId: 6379656, updatedExisting: true, n: 1, syncMillis: 5, writtenTo: null, err: null, waited: 5, ok: 1.0 } 2017-01-22T01:53:21.309-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-22T01:53:21.310-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:53:21.376-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:53:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:53:21.376-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-22T01:53:21.482-0500 [LockPinger] handled late remove of old distributed lock with ts 588456e19527cdec667c0e7f 2017-01-22T01:53:45.736-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588456f99527cdec667c0e80 2017-01-22T01:53:46.332-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T01:53:51.755-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:53:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:53:52.567-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:53:52.567-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:54:22.036-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:54:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:54:29.148-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:54:29.148-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:54:35.371-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:54:35.372-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:54:52.264-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:54:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:55:18.053-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:55:18.053-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:55:22.458-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:55:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:55:42.633-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:55:42.633-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:55:48.783-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:55:48.783-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:55:52.607-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:55:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:56:22.929-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:56:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:56:53.267-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:56:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:56:55.668-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:56:55.668-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:57:02.016-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588457bd9527cdec667c0e88 2017-01-22T01:57:02.797-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T01:57:23.517-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:57:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:57:53.809-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:57:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:58:03.848-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:58:03.848-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:58:24.072-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:58:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:58:28.204-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:58:28.204-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:58:40.508-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5884581f7a89357edd325a21') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485068320317), why: "doing balance round", ts: ObjectId('588458209527cdec667c0e8b') } } gle1: { lastOp: Timestamp 1485068222000|35, connectionId: 21778, updatedExisting: false, n: 0, syncMillis: 13, writtenTo: null, err: null, waited: 13, ok: 1.0 } gle2: { lastOp: Timestamp 1485068320000|13, connectionId: 6379656, updatedExisting: true, n: 1, syncMillis: 13, writtenTo: null, err: null, waited: 13, ok: 1.0 } 2017-01-22T01:58:40.525-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-22T01:58:40.654-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588458209527cdec667c0e8b 2017-01-22T01:58:41.213-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-22T01:58:53.541-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:58:53.541-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:58:54.366-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:58:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:59:24.284-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:59:24.284-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:59:24.636-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:59:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T01:59:49.447-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-22T01:59:49.447-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-22T01:59:54.895-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 01:59:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:00:25.200-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:00:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:00:55.524-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:00:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:01:25.788-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:01:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:01:56.143-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:01:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:02:26.422-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:02:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:02:56.710-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:02:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:03:27.003-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:03:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:03:57.265-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:03:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:04:27.529-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:04:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:04:57.794-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:04:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:05:27.934-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:05:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:05:58.214-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:05:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:06:28.511-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:06:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:06:58.838-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:06:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:07:29.141-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:07:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:07:59.449-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:07:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:08:29.596-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:08:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:08:59.920-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:08:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:09:30.205-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:09:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:10:00.480-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:10:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:10:30.792-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:10:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:11:01.168-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:11:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:11:31.535-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:11:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:12:01.804-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:12:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:12:32.176-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:12:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:13:02.577-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:13:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:13:32.851-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:13:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:14:03.128-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:14:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:14:33.391-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:14:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:15:03.677-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:15:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:15:33.995-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:15:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:16:04.355-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:16:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:16:34.613-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:16:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:17:04.901-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:17:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:17:35.210-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:17:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:18:05.595-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:18:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:18:35.837-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:18:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:19:06.045-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:19:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:19:36.353-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:19:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:20:06.625-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:20:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:20:36.907-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:20:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:21:07.043-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:21:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:21:37.329-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:21:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:22:07.695-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:22:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:22:37.920-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:22:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:23:08.209-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:23:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:23:38.547-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:23:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:24:09.000-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:24:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:24:39.286-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:24:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:25:09.476-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:25:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:25:39.783-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:25:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:26:09.920-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:26:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:26:40.211-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:26:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:27:10.554-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:27:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:27:40.945-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:27:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:28:11.338-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:28:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:28:41.536-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:28:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:29:11.802-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:29:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:29:41.987-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:29:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:30:12.260-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:30:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:30:42.652-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:30:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:31:12.992-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:31:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:31:43.309-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:31:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:32:13.613-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:32:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:32:43.880-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:32:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:33:14.180-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:33:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:33:44.441-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:33:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:34:14.634-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:34:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:34:45.022-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:34:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:35:15.210-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:35:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:35:45.519-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:35:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:36:15.782-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:36:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:36:46.216-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:36:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:37:16.501-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:37:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:37:46.778-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:37:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:38:17.032-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:38:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:38:47.168-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:38:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:39:17.338-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:39:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:39:47.625-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:39:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:40:17.826-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:40:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:40:47.998-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:40:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:41:18.312-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:41:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:41:48.583-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:41:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:42:18.895-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:42:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:42:49.210-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:42:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:43:19.500-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:43:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:43:49.694-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:43:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:44:19.959-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:44:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:44:50.243-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:44:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:45:20.429-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:45:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:45:50.612-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:45:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:46:20.927-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:46:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:46:51.208-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:46:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:47:21.400-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:47:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:47:51.689-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:47:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:48:21.957-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:48:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:48:52.242-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:48:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:49:22.546-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:49:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:49:52.935-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:49:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:50:23.263-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:50:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:50:53.544-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:50:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:51:23.844-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:51:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:51:54.151-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:51:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:52:24.426-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:52:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:52:54.569-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:52:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:53:24.715-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:53:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:53:55.129-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:53:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:54:25.500-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:54:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:54:55.784-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:54:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:55:25.979-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:55:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:55:56.366-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:55:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:56:26.652-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:56:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:56:56.792-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:56:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:57:27.071-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:57:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:57:57.352-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:57:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:58:27.652-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:58:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:58:57.947-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:58:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:59:28.200-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:59:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T02:59:58.472-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 02:59:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:00:28.718-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:00:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:00:59.020-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:00:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:01:29.226-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:01:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:01:59.479-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:01:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:02:29.639-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:02:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:02:59.935-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:02:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:03:30.121-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:03:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:04:00.374-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:04:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:04:30.684-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:04:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:05:00.890-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:05:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:05:31.213-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:05:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:06:01.495-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:06:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:06:31.708-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:06:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:07:02.003-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:07:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:07:32.368-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:07:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:08:02.636-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:08:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:08:32.851-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:08:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:09:03.118-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:09:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:09:33.409-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:09:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:10:03.682-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:10:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:10:33.976-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:10:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:11:04.262-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:11:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:11:34.535-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:11:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:12:04.839-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:12:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:12:35.118-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:12:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:13:05.504-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:13:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:13:35.814-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:13:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:14:06.075-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:14:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:14:36.395-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:14:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:15:06.601-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:15:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:15:36.803-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:15:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:16:07.032-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:16:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:16:37.313-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:16:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:17:07.599-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:17:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:17:37.767-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:17:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:18:08.104-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:18:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:18:38.261-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:18:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:19:08.543-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:19:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:19:38.937-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:19:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:20:09.214-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:20:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:20:39.423-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:20:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:21:09.591-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:21:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:21:39.866-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:21:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:22:10.131-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:22:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:22:40.513-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:22:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:23:10.954-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:23:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:23:41.248-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:23:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:24:11.393-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:24:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:24:41.768-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:24:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:25:11.950-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:25:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:25:42.224-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:25:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:26:12.431-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:26:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:26:42.576-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:26:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:27:12.857-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:27:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:27:43.049-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:27:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:28:13.292-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:28:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:28:43.571-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:28:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:29:13.966-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:29:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:29:44.164-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:29:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:30:14.471-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:30:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:30:44.661-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:30:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:31:14.858-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:31:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:31:45.144-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:31:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:32:15.436-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:32:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:32:45.692-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:32:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:33:15.951-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:33:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:33:46.234-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:33:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:34:16.528-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:34:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:34:46.861-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:34:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:35:17.154-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:35:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:35:47.353-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:35:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:36:17.671-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:36:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:36:47.937-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:36:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:37:18.150-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:37:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:37:48.361-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:37:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:38:18.700-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:38:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:38:49.083-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:38:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:39:19.219-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:39:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:39:49.484-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:39:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:40:19.752-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:40:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:40:50.024-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:40:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:41:20.345-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:41:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:41:50.632-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:41:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:42:20.905-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:42:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:42:51.187-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:42:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:43:21.351-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:43:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:43:51.596-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:43:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:44:21.873-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:44:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:44:52.131-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:44:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:45:22.474-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:45:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:45:52.737-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:45:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:46:22.888-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:46:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:46:53.351-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:46:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:47:23.626-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:47:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:47:53.943-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:47:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:48:24.223-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:48:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:48:54.361-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:48:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:49:24.614-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:49:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:49:54.904-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:49:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:50:25.188-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:50:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:50:55.537-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:50:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:51:25.803-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:51:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:51:56.054-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:51:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:52:26.340-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:52:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:52:56.486-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:52:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:53:26.795-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:53:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:53:57.084-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:53:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:54:27.251-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:54:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:54:57.546-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:54:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:55:27.854-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:55:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:55:58.154-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:55:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:56:28.521-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:56:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:56:58.800-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:56:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:57:29.210-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:57:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:57:59.570-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:57:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:58:29.774-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:58:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:58:59.937-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:58:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T03:59:30.235-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 03:59:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:00:00.527-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:00:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:00:30.788-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:00:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:01:01.033-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:01:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:01:31.304-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:01:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:02:01.553-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:02:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:02:31.745-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:02:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:03:02.001-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:03:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:03:32.322-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:03:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:04:02.541-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:04:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:04:32.825-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:04:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:05:03.029-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:05:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:05:33.223-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:05:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:06:03.624-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:06:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:06:33.917-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:06:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:07:04.181-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:07:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:07:34.518-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:07:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:08:04.865-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:08:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:08:35.095-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:08:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:09:05.389-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:09:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:09:35.629-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:09:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:10:05.920-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:10:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:10:36.181-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:10:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:11:06.462-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:11:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:11:36.843-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:11:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:12:07.049-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:12:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:12:37.336-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:12:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:13:07.472-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:13:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:13:37.697-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:13:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:14:08.003-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:14:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:14:38.359-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:14:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:15:08.621-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:15:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:15:38.842-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:15:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:16:09.036-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:16:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:16:39.243-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:16:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:17:09.393-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:17:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:17:39.808-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:17:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:18:10.105-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:18:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:18:40.258-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:18:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:19:10.496-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:19:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:19:40.686-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:19:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:20:11.039-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:20:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:20:41.318-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:20:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:21:11.595-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:21:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:21:41.878-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:21:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:22:12.145-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:22:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:22:42.427-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:22:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:23:12.727-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:23:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:23:43.003-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:23:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:24:13.269-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:24:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:24:43.436-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:24:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:25:13.722-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:25:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:25:43.972-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:25:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:26:14.244-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:26:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:26:44.391-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:26:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:27:14.623-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:27:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:27:44.908-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:27:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:28:15.073-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:28:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:28:45.386-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:28:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:29:15.658-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:29:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:29:45.994-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:29:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:30:16.269-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:30:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:30:46.523-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:30:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:31:16.710-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:31:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:31:46.999-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:31:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:32:17.358-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:32:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:32:47.654-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:32:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:33:17.936-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:33:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:33:48.207-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:33:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:34:18.462-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:34:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:34:48.766-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:34:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:35:18.965-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:35:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:35:49.123-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:35:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:36:19.439-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:36:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:36:49.730-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:36:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:37:19.998-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:37:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:37:50.268-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:37:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:38:20.423-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:38:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:38:50.638-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:38:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:39:20.823-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:39:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:39:51.072-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:39:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:40:21.372-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:40:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:40:51.644-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:40:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:41:21.819-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:41:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:41:52.083-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:41:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:42:22.328-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:42:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:42:52.615-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:42:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:43:22.901-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:43:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:43:53.170-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:43:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:44:23.412-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:44:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:44:53.754-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:44:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:45:23.999-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:45:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:45:54.291-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:45:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:46:24.556-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:46:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:46:54.695-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:46:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:47:24.927-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:47:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:47:55.200-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:47:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:48:25.452-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:48:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:48:55.808-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:48:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:49:26.103-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:49:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:49:56.368-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:49:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:50:26.715-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:50:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:50:56.908-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:50:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:51:27.094-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:51:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:51:57.293-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:51:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:52:27.675-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:52:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:52:57.972-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:52:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:53:28.216-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:53:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:53:58.499-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:53:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:54:28.782-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:54:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:54:59.078-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:54:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:55:29.338-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:55:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:55:59.630-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:55:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:56:29.888-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:56:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:57:00.166-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:56:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:57:30.436-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:57:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:58:00.647-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:58:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:58:30.908-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:58:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:59:01.255-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:59:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T04:59:31.565-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 04:59:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:00:01.830-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:00:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:00:32.113-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:00:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:01:02.332-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:01:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:01:32.485-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:01:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:02:02.635-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:02:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:02:32.925-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:02:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:03:03.071-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:03:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:03:33.254-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:03:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:04:03.666-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:04:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:04:34.084-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:04:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:05:04.365-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:05:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:05:34.694-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:05:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:06:04.948-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:06:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:06:35.140-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:06:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:07:05.285-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:07:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:07:35.619-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:07:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:08:05.913-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:08:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:08:36.207-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:08:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:09:06.488-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:09:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:09:36.708-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:09:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:10:06.928-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:10:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:10:37.190-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:10:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:11:07.428-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:11:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:11:37.695-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:11:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:12:07.917-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:12:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:12:38.220-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:12:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:13:08.491-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:13:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:13:38.765-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:13:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:14:09.175-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:14:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:14:39.461-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:14:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:15:09.752-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:15:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:15:40.032-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:15:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:16:10.328-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:16:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:16:40.585-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:16:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:17:10.896-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:17:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:17:41.166-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:17:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:18:11.405-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:18:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:18:41.608-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:18:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:19:11.756-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:19:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:19:42.011-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:19:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:20:12.436-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:20:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:20:42.690-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:20:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:21:12.978-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:21:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:21:43.170-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:21:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:22:13.440-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:22:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:22:43.636-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:22:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:23:13.946-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:23:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:23:44.119-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:23:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:24:14.438-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:24:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:24:44.794-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:24:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:25:15.039-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:25:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:25:45.301-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:25:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:26:15.559-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:26:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:26:45.848-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:26:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:27:16.158-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:27:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:27:46.364-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:27:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:28:16.695-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:28:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:28:46.978-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:28:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:29:17.180-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:29:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:29:47.573-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:29:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:30:17.723-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:30:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:30:47.966-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:30:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:31:18.408-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:31:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:31:48.701-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:31:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:32:18.914-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:32:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:32:49.209-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:32:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:33:19.480-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:33:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:33:49.658-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:33:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:34:19.932-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:34:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:34:50.097-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:34:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:35:20.365-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:35:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:35:50.682-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:35:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:36:21.111-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:36:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:36:51.373-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:36:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:37:21.653-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:37:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:37:51.836-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:37:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:38:22.151-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:38:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:38:52.425-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:38:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:39:22.739-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:39:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:39:53.029-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:39:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:40:23.331-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:40:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:40:53.608-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:40:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:41:23.897-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:41:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:41:54.191-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:41:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:42:24.387-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:42:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:42:54.662-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:42:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:43:25.031-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:43:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:43:55.208-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:43:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:44:25.501-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:44:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:44:55.806-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:44:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:45:26.127-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:45:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:45:56.426-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:45:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:46:26.746-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:46:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:46:57.138-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:46:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:47:27.451-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:47:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:47:57.739-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:47:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:48:28.017-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:48:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:48:58.253-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:48:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:49:28.588-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:49:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:49:58.856-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:49:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:50:29.134-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:50:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:50:59.430-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:50:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:51:29.711-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:51:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:51:59.995-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:51:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:52:30.239-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:52:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:53:00.497-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:53:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:53:30.684-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:53:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:54:00.973-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:54:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:54:31.232-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:54:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:55:01.501-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:55:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:55:31.778-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:55:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:56:02.048-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:56:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:56:32.355-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:56:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:57:02.688-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:57:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:57:33.008-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:57:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:58:03.198-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:58:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:58:33.418-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:58:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:59:03.707-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:59:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T05:59:34.080-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 05:59:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:00:04.333-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:00:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:00:34.632-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:00:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:01:04.907-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:01:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:01:35.119-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:01:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:02:05.307-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:02:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:02:35.586-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:02:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:03:05.756-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:03:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:03:35.962-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:03:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:04:06.236-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:04:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:04:36.493-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:04:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:05:06.684-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:05:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:05:36.961-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:05:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:06:07.258-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:06:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:06:37.521-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:06:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:07:07.800-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:07:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:07:38.061-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:07:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:08:08.344-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:08:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:08:38.599-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:08:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:09:08.868-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:09:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:09:39.104-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:09:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:10:09.301-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:10:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:10:39.651-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:10:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:11:09.883-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:11:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:11:40.273-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:11:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:12:10.590-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:12:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:12:40.925-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:12:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:13:11.123-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:13:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:13:41.387-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:13:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:14:11.697-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:14:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:14:41.988-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:14:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:15:12.258-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:15:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:15:42.537-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:15:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:16:12.827-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:16:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:16:43.163-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:16:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:17:13.454-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:17:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:17:43.725-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:17:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:18:14.018-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:18:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:18:44.269-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:18:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:19:14.407-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:19:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:19:44.723-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:19:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:20:15.010-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:20:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:20:45.369-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:20:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:21:15.613-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:21:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:21:45.853-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:21:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:22:16.103-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:22:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:22:46.342-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:22:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:23:16.632-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:23:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:23:46.841-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:23:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:24:17.141-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:24:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:24:47.290-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:24:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:25:17.576-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:25:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:25:47.837-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:25:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:26:18.247-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:26:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:26:48.383-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:26:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:27:18.579-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:27:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:27:48.880-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:27:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:28:19.176-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:28:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:28:49.456-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:28:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:29:19.626-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:29:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:29:49.920-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:29:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:30:20.207-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:30:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:30:50.487-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:30:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:31:20.677-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:31:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:31:50.869-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:31:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:32:21.129-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:32:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:32:51.371-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:32:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:33:21.512-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:33:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:33:51.776-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:33:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:34:22.082-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:34:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:34:52.344-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:34:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:35:22.626-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:35:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:35:52.888-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:35:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:36:23.118-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:36:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:36:53.383-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:36:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:37:23.534-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:37:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:37:53.674-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:37:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:38:23.961-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:38:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:38:54.249-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:38:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:39:24.525-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:39:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:39:54.804-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:39:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:40:25.074-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:40:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:40:55.343-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:40:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:41:25.625-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:41:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:41:55.998-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:41:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:42:26.284-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:42:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:42:56.638-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:42:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:43:26.922-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:43:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:43:57.119-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:43:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:44:27.360-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:44:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:44:57.637-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:44:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:45:27.936-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:45:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:45:58.203-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:45:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:46:28.503-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:46:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:46:58.647-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:46:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:47:29.011-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:47:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:47:59.205-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:47:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:48:29.440-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:48:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:48:59.723-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:48:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:49:30.096-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:49:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:50:00.377-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:50:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:50:30.760-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:50:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:51:01.049-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:51:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:51:31.313-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:51:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:52:01.472-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:52:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:52:31.767-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:52:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:53:02.048-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:53:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:53:32.325-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:53:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:54:02.762-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:54:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:54:33.044-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:54:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:55:03.323-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:55:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:55:33.585-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:55:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:56:03.909-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:56:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:56:34.262-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:56:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:57:04.403-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:57:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:57:34.643-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:57:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:58:04.902-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:58:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:58:35.203-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:58:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:59:05.476-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:59:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T06:59:35.849-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 06:59:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:00:06.144-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:00:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:00:36.472-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:00:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:01:06.830-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:01:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:01:37.178-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:01:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:02:07.471-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:02:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:02:37.599-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:02:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:03:07.849-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:03:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:03:37.986-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:03:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:04:08.260-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:04:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:04:38.552-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:04:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:05:08.835-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:05:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:05:39.208-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:05:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:06:09.490-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:06:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:06:39.922-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:06:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:07:10.183-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:07:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:07:40.436-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:07:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:08:10.738-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:08:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:08:41.015-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:08:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:09:11.413-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:09:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:09:41.685-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:09:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:10:11.932-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:10:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:10:42.230-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:10:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:11:12.471-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:11:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:11:42.758-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:11:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:12:13.109-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:12:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:12:43.465-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:12:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:13:13.765-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:13:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:13:44.124-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:13:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:14:14.429-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:14:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:14:44.840-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:14:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:15:15.124-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:15:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:15:45.385-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:15:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:16:15.675-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:16:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:16:45.914-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:16:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:17:16.061-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:17:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:17:46.384-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:17:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:18:16.574-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:18:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:18:46.901-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:18:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:19:17.082-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:19:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:19:47.345-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:19:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:20:17.534-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:20:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:20:47.795-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:20:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:21:18.079-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:21:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:21:48.364-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:21:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:22:18.652-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:22:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:22:48.943-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:22:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:23:19.229-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:23:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:23:49.466-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:23:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:24:19.759-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:24:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:24:49.968-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:24:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:25:20.313-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:25:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:25:50.529-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:25:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:26:20.813-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:26:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:26:51.017-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:26:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:27:21.317-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:27:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:27:51.545-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:27:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:28:21.869-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:28:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:28:52.216-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:28:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:29:22.494-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:29:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:29:52.791-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:29:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:30:23.097-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:30:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:30:53.338-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:30:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:31:23.700-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:31:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:31:54.007-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:31:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:32:24.280-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:32:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:32:54.556-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:32:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:33:24.917-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:33:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:33:55.213-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:33:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:34:25.615-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:34:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:34:55.918-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:34:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:35:26.212-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:35:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:35:56.496-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:35:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:36:26.693-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:36:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:36:56.979-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:36:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:37:27.260-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:37:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:37:57.406-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:37:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:38:27.622-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:38:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:38:57.914-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:38:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:39:28.160-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:39:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:39:58.445-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:39:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:40:28.591-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:40:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:40:58.893-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:40:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:41:29.120-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:41:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:41:59.403-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:41:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:42:29.669-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:42:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:42:59.999-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:42:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:43:30.285-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:43:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:44:00.522-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:44:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:44:30.816-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:44:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:45:01.090-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:45:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:45:31.391-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:45:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:46:01.551-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:46:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:46:31.849-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:46:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:47:01.999-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:47:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:47:32.281-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:47:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:48:02.717-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:48:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:48:32.983-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:48:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:49:03.252-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:49:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:49:33.521-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:49:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:50:03.858-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:50:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:50:34.015-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:50:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:51:04.217-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:51:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:51:34.378-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:51:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:52:04.586-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:52:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:52:34.773-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:52:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:53:05.042-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:53:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:53:35.370-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:53:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:54:05.676-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:54:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:54:35.940-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:54:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:55:06.204-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:55:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:55:36.478-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:55:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:56:06.771-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:56:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:56:36.929-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:56:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:57:07.201-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:57:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:57:37.489-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:57:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:58:07.670-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:58:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:58:37.922-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:58:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:59:08.197-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:59:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T07:59:38.392-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 07:59:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:00:08.738-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:00:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:00:39.022-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:00:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:01:09.395-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:01:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:01:39.541-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:01:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:02:09.819-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:02:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:02:40.137-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:02:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:03:10.317-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:03:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:03:40.740-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:03:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:04:10.993-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:04:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:04:41.307-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:04:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:05:11.576-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:05:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:05:41.914-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:05:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:06:12.070-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:06:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:06:42.351-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:06:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:07:12.634-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:07:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:07:42.827-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:07:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:08:13.094-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:08:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:08:43.300-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:08:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:09:13.528-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:09:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:09:43.674-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:09:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:10:13.855-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:10:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:10:44.275-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:10:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:11:14.568-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:11:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:11:44.928-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:11:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:12:15.210-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:12:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:12:45.493-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:12:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:13:15.838-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:13:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:13:46.020-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:13:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:14:16.328-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:14:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:14:46.611-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:14:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:15:16.882-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:15:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:15:47.030-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:15:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:16:17.311-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:16:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:16:47.720-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:16:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:17:18.008-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:17:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:17:48.293-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:17:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:18:18.573-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:18:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:18:48.879-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:18:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:19:19.156-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:19:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:19:49.395-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:19:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:20:19.753-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:20:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:20:50.052-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:20:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:21:20.213-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:21:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:21:50.509-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:21:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:22:20.657-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:22:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:22:50.954-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:22:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:23:21.261-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:23:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:23:51.400-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:23:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:24:21.657-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:24:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:24:51.804-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:24:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:25:22.023-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:25:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:25:52.329-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:25:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:26:22.611-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:26:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:26:52.906-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:26:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:27:23.056-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:27:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:27:53.351-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:27:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:28:23.634-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:28:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:28:53.788-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:28:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:29:24.011-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:29:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:29:54.174-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:29:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:30:24.457-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:30:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:30:54.716-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:30:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:31:25.111-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:31:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:31:55.397-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:31:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:32:25.668-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:32:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:32:55.943-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:32:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:33:26.263-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:33:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:33:56.434-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:33:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:34:26.699-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:34:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:34:56.990-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:34:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:35:27.332-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:35:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:35:57.460-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:35:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:36:27.726-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:36:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:36:57.930-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:36:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:37:28.216-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:37:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:37:58.490-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:37:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:38:28.773-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:38:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:38:59.053-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:38:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:39:29.323-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:39:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:39:59.588-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:39:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:40:29.902-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:40:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:41:00.166-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:40:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:41:30.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:41:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:42:00.646-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:42:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:42:30.907-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:42:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:43:01.311-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:43:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:43:31.595-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:43:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:44:01.956-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:44:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:44:32.241-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:44:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:45:02.375-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:45:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:45:32.598-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:45:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:46:02.843-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:46:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:46:33.019-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:46:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:47:03.303-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:47:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:47:33.688-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:47:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:48:04.019-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:48:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:48:34.171-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:48:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:49:04.459-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:49:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:49:34.725-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:49:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:50:04.972-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:50:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:50:35.262-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:50:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:51:05.671-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:51:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:51:36.001-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:51:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:52:06.239-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:52:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:52:36.704-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:52:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:53:07.008-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:53:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:53:37.295-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:53:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:54:07.520-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:54:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:54:37.820-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:54:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:55:08.226-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:55:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:55:38.548-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:55:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:56:08.823-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:56:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:56:39.095-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:56:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:57:09.461-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:57:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:57:39.625-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:57:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:58:09.880-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:58:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:58:40.147-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:58:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:59:10.434-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:59:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T08:59:40.710-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 08:59:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:00:11.046-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:00:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:00:41.379-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:00:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:01:11.655-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:01:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:01:41.942-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:01:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:02:12.247-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:02:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:02:42.514-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:02:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:03:12.765-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:03:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:03:43.035-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:03:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:04:13.312-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:04:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:04:43.682-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:04:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:05:14.084-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:05:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:05:44.300-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:05:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:06:14.734-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:06:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:06:45.135-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:06:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:07:15.534-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:07:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:07:45.828-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:07:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:08:16.138-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:08:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:08:46.357-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:08:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:09:16.671-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:09:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:09:47.015-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:09:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:10:17.224-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:10:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:10:47.521-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:10:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:11:17.769-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:11:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:11:47.940-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:11:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:12:18.256-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:12:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:12:48.690-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:12:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:13:18.956-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:13:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:13:49.241-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:13:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:14:19.614-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:14:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:14:49.874-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:14:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:15:20.168-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:15:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:15:50.640-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:15:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:16:20.947-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:16:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:16:51.247-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:16:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:17:21.626-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:17:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:17:51.907-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:17:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:18:22.210-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:18:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:18:52.421-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:18:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:19:22.742-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:19:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:19:52.984-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:19:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:20:23.168-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:20:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:20:53.361-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:20:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:21:23.556-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:21:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:21:53.866-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:21:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:22:24.197-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:22:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:22:54.537-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:22:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:23:24.831-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:23:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:23:55.156-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:23:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:24:25.513-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:24:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:24:55.814-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:24:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:25:25.970-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:25:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:25:56.123-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:25:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:26:26.307-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:26:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:26:56.616-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:26:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:27:26.908-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:27:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:27:57.146-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:27:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:28:27.468-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:28:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:28:57.758-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:28:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:29:28.068-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:29:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:29:58.376-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:29:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:30:28.681-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:30:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:30:59.049-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:30:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:31:29.205-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:31:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:31:59.415-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:31:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:32:29.786-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:32:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:33:00.228-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:32:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:33:30.577-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:33:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:34:00.832-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:34:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:34:31.206-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:34:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:35:01.483-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:35:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:35:31.653-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:35:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:36:01.939-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:36:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:36:32.261-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:36:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:37:02.499-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:37:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:37:32.850-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:37:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:38:03.091-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:38:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:38:33.458-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:38:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:39:03.646-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:39:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:39:33.932-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:39:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:40:04.082-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:40:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:40:34.383-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:40:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:41:04.693-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:41:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:41:34.842-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:41:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:42:05.098-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:42:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:42:35.477-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:42:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:43:05.827-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:43:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:43:36.058-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:43:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:44:06.315-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:44:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:44:36.601-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:44:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:45:06.891-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:45:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:45:37.265-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:45:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:46:07.634-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:46:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:46:37.916-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:46:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:47:08.228-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:47:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:47:38.382-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:47:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:48:08.649-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:48:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:48:38.863-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:48:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:49:09.157-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:49:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:49:39.562-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:49:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:50:09.925-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:50:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:50:40.166-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:50:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:51:10.348-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:51:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:51:40.632-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:51:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:52:10.852-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:52:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:52:41.177-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:52:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:53:11.389-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:53:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:53:41.688-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:53:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:54:11.886-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:54:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:54:42.312-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:54:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:55:12.545-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:55:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:55:42.707-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:55:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:56:12.927-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:56:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:56:43.241-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:56:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:57:13.548-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:57:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:57:43.727-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:57:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:58:14.020-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:58:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:58:44.286-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:58:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:59:15.287-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:59:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T09:59:45.534-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 09:59:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:00:15.807-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:00:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:00:46.054-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:00:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:01:16.347-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:01:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:01:46.535-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:01:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:02:16.758-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:02:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:02:47.058-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:02:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:03:17.328-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:03:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:03:47.598-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:03:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:04:17.792-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:04:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:04:48.067-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:04:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:05:18.335-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:05:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:05:48.591-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:05:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:06:18.864-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:06:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:06:49.142-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:06:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:07:19.509-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:07:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:07:49.817-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:07:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:08:20.096-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:08:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:08:50.289-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:08:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:09:20.591-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:09:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:09:50.762-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:09:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:10:21.075-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:10:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:10:51.301-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:10:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:11:21.616-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:11:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:11:51.931-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:11:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:12:22.324-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:12:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:12:52.720-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:12:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:13:23.001-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:13:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:13:53.345-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:13:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:14:23.618-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:14:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:14:53.889-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:14:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:15:24.203-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:15:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:15:54.488-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:15:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:16:24.755-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:16:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:16:54.932-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:16:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:17:25.234-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:17:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:17:55.564-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:17:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:18:25.846-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:18:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:18:56.079-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:18:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:19:26.489-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:19:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:19:56.811-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:19:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:20:27.097-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:20:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:20:57.394-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:20:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:21:27.569-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:21:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:21:57.859-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:21:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:22:28.322-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:22:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:22:58.600-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:22:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:23:28.946-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:23:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:23:59.109-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:23:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:24:29.391-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:24:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:24:59.680-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:24:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:25:30.036-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:25:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:26:00.169-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:26:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:26:30.471-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:26:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:27:00.775-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:27:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:27:31.046-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:27:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:28:01.375-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:28:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:28:31.678-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:28:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:29:01.989-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:29:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:29:32.364-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:29:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:30:02.700-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:30:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:30:33.018-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:30:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:31:03.333-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:31:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:31:33.663-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:31:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:32:03.941-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:32:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:32:34.221-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:32:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:33:04.588-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:33:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:33:34.783-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:33:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:34:05.109-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:34:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:34:35.493-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:34:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:35:05.949-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:35:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:35:36.268-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:35:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:36:06.584-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:36:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:36:36.836-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:36:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:37:07.115-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:37:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:37:37.412-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:37:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:38:07.591-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:38:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:38:37.851-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:38:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:39:08.305-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:39:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:39:38.554-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:39:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:40:08.801-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:40:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:40:39.031-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:40:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:41:09.338-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:41:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:41:39.578-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:41:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:42:09.959-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:42:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:42:40.138-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:42:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:43:10.454-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:43:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:43:40.728-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:43:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:44:11.130-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:44:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:44:41.401-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:44:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:45:11.671-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:45:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:45:42.049-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:45:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:46:12.213-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:46:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:46:42.504-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:46:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:47:12.802-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:47:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:47:43.094-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:47:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:48:13.249-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:48:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:48:43.534-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:48:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:49:13.867-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:49:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:49:44.109-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:49:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:50:14.447-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:50:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:50:44.723-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:50:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:51:14.964-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:51:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:51:45.320-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:51:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:52:15.594-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:52:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:52:45.815-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:52:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:53:16.099-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:53:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:53:46.386-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:53:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:54:16.538-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:54:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:54:46.681-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:54:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:55:16.859-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:55:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:55:47.011-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:55:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:56:17.294-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:56:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:56:47.518-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:56:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:57:17.840-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:57:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:57:48.137-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:57:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:58:18.438-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:58:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:58:48.638-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:58:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:59:18.931-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:59:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T10:59:49.207-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 10:59:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:00:19.373-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:00:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:00:49.622-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:00:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:01:19.771-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:01:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:01:50.064-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:01:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:02:20.355-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:02:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:02:50.651-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:02:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:03:21.167-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:03:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:03:51.358-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:03:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:04:21.745-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:04:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:04:52.026-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:04:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:05:22.305-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:05:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:05:52.505-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:05:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:06:22.668-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:06:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:06:52.908-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:06:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:07:23.199-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:07:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:07:53.622-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:07:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:08:24.055-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:08:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:08:54.325-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:08:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:09:24.599-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:09:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:09:54.872-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:09:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:10:25.292-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:10:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:10:55.564-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:10:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:11:25.948-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:11:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:11:56.139-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:11:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:12:26.473-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:12:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:12:56.792-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:12:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:13:26.952-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:13:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:13:57.328-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:13:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:14:27.574-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:14:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:14:57.855-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:14:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:15:28.081-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:15:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:15:58.337-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:15:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:16:28.633-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:16:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:16:58.908-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:16:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:17:29.263-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:17:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:17:59.523-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:17:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:18:29.807-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:18:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:18:59.979-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:18:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:19:30.355-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:19:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:20:00.644-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:20:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:20:30.794-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:20:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:21:00.967-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:21:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:21:31.262-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:21:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:22:01.578-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:22:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:22:31.862-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:22:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:23:02.145-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:23:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:23:32.338-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:23:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:24:02.578-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:24:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:24:32.827-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:24:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:25:03.244-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:25:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:25:33.537-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:25:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:26:03.851-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:26:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:26:34.166-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:26:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:27:04.445-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:27:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:27:34.646-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:27:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:28:04.818-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:28:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:28:35.248-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:28:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:29:05.609-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:29:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:29:35.911-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:29:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:30:06.264-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:30:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:30:36.580-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:30:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:31:06.760-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:31:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:31:36.970-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:31:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:32:07.151-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:32:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:32:37.505-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:32:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:33:07.802-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:33:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:33:37.984-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:33:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:34:08.253-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:34:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:34:38.464-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:34:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:35:08.781-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:35:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:35:39.103-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:35:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:36:09.397-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:36:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:36:39.662-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:36:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:37:09.931-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:37:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:37:40.186-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:37:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:38:10.459-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:38:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:38:40.838-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:38:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:39:11.097-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:39:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:39:41.385-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:39:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:40:11.686-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:40:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:40:41.874-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:40:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:41:12.076-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:41:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:41:42.217-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:41:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:42:12.567-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:42:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:42:42.854-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:42:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:43:13.108-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:43:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:43:43.446-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:43:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:44:13.814-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:44:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:44:44.113-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:44:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:45:14.389-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:45:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:45:44.609-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:45:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:46:14.878-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:46:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:46:45.111-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:46:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:47:15.413-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:47:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:47:45.686-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:47:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:48:15.933-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:48:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:48:46.197-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:48:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:49:16.335-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:49:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:49:46.686-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:49:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:50:16.974-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:50:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:50:47.112-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:50:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:51:17.440-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:51:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:51:47.643-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:51:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:52:18.004-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:52:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:52:48.268-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:52:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:53:18.477-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:53:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:53:48.726-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:53:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:54:18.978-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:54:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:54:49.149-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:54:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:55:19.348-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:55:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:55:49.505-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:55:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:56:19.790-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:56:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:56:50.102-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:56:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:57:20.347-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:57:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:57:50.497-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:57:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:58:20.675-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:58:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:58:51.002-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:58:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:59:21.319-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:59:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T11:59:51.499-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 11:59:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:00:21.774-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:00:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:00:51.920-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:00:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:01:22.100-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:01:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:01:52.355-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:01:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:02:22.613-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:02:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:02:52.914-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:02:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:03:23.221-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:03:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:03:53.544-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:03:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:04:23.825-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:04:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:04:54.096-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:04:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:05:24.431-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:05:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:05:54.660-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:05:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:06:25.052-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:06:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:06:55.458-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:06:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:07:25.725-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:07:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:07:55.886-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:07:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:08:26.098-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:08:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:08:56.447-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:08:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:09:26.701-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:09:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:09:56.973-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:09:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:10:27.258-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:10:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:10:57.531-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:10:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:11:27.790-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:11:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:11:58.110-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:11:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:12:28.403-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:12:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:12:58.584-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:12:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:13:28.855-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:13:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:13:59.116-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:13:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:14:29.465-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:14:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:14:59.742-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:14:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:15:29.960-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:15:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:16:00.206-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:15:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:16:30.540-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:16:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:17:00.936-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:17:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:17:31.219-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:17:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:18:01.442-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:18:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:18:31.707-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:18:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:19:02.094-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:19:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:19:32.402-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:19:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:20:02.688-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:20:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:20:32.970-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:20:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:21:03.308-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:21:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:21:33.566-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:21:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:22:03.830-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:22:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:22:34.257-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:22:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:23:04.572-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:23:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:23:34.926-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:23:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:24:05.201-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:24:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:24:35.499-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:24:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:25:05.797-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:25:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:25:36.082-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:25:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:26:06.338-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:26:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:26:36.606-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:26:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:27:06.872-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:27:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:27:37.162-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:27:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:28:07.427-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:28:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:28:37.709-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:28:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:29:07.868-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:29:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:29:38.096-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:29:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:30:08.364-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:30:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:30:38.710-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:30:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:31:08.965-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:31:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:31:39.282-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:31:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:32:10.084-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:32:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:32:40.376-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:32:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:33:10.633-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:33:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:33:40.768-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:33:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:34:10.923-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:34:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:34:41.312-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:34:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:35:11.591-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:35:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:35:41.813-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:35:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:36:12.083-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:36:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:36:42.253-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:36:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:37:12.550-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:37:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:37:42.828-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:37:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:38:13.092-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:38:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:38:43.392-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:38:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:39:13.685-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:39:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:39:43.959-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:39:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:40:14.368-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:40:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:40:44.522-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:40:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:41:14.917-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:41:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:41:45.045-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:41:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:42:15.325-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:42:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:42:45.695-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:42:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:43:15.958-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:43:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:43:46.140-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:43:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:44:16.395-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:44:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:44:46.614-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:44:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:45:16.937-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:45:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:45:47.215-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:45:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:46:17.363-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:46:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:46:47.626-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:46:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:47:17.803-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:47:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:47:48.053-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:47:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:48:18.330-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:48:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:48:48.575-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:48:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:49:18.742-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:49:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:49:49.023-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:49:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:50:19.281-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:50:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:50:49.535-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:50:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:51:19.817-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:51:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:51:50.080-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:51:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:52:20.364-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:52:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:52:50.521-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:52:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:53:20.662-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:53:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:53:51.115-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:53:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:54:21.407-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:54:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:54:51.645-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:54:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:55:21.978-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:55:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:55:52.260-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:55:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:56:22.557-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:56:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:56:52.994-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:56:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:57:23.186-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:57:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:57:53.457-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:57:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:58:23.767-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:58:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:58:54.138-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:58:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:59:24.368-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:59:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T12:59:54.662-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 12:59:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:00:24.939-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:00:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:00:55.229-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:00:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:01:25.456-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:01:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:01:55.585-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:01:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:02:25.852-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:02:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:02:56.098-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:02:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:03:26.395-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:03:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:03:56.753-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:03:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:04:27.015-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:04:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:04:57.296-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:04:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:05:27.528-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:05:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:05:57.878-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:05:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:06:28.216-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:06:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:06:58.506-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:06:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:07:28.760-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:07:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:07:59.063-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:07:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:08:29.333-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:08:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:08:59.611-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:08:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:09:29.918-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:09:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:10:00.181-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:09:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:10:30.581-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:10:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:11:00.918-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:11:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:11:31.204-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:11:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:12:01.472-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:12:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:12:31.629-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:12:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:13:01.921-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:13:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:13:32.152-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:13:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:14:02.311-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:14:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:14:32.568-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:14:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:15:02.816-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:15:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:15:33.160-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:15:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:16:03.423-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:16:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:16:33.603-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:16:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:17:03.900-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:17:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:17:34.220-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:17:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:18:04.507-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:18:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:18:34.739-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:18:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:19:05.121-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:19:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:19:35.403-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:19:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:20:05.736-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:20:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:20:35.899-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:20:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:21:06.170-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:21:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:21:36.489-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:21:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:22:06.725-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:22:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:22:37.015-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:22:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:23:07.301-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:23:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:23:37.607-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:23:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:24:07.837-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:24:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:24:38.043-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:24:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:25:08.308-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:25:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:25:38.686-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:25:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:26:09.096-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:26:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:26:39.403-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:26:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:27:09.702-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:27:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:27:39.986-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:27:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:28:10.155-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:28:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:28:40.445-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:28:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:29:10.835-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:29:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:29:41.123-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:29:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:30:11.346-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:30:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:30:41.659-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:30:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:31:11.795-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:31:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:31:42.053-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:31:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:32:12.327-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:32:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:32:42.716-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:32:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:33:12.913-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:33:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:33:43.254-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:33:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:34:13.523-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:34:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:34:43.800-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:34:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:35:14.052-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:35:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:35:44.215-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:35:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:36:14.405-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:36:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:36:44.642-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:36:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:37:15.088-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:37:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:37:45.450-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:37:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:38:15.679-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:38:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:38:45.835-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:38:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:39:16.179-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:39:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:39:46.464-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:39:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:40:16.611-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:40:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:40:47.014-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:40:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:41:17.301-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:41:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:41:47.558-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:41:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:42:17.883-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:42:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:42:48.162-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:42:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:43:18.427-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:43:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:43:48.713-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:43:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:44:18.854-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:44:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:44:49.212-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:44:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:45:19.517-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:45:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:45:49.893-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:45:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:46:20.190-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:46:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:46:50.473-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:46:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:47:20.623-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:47:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:47:50.882-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:47:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:48:21.176-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:48:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:48:51.343-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:48:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:49:21.559-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:49:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:49:51.842-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:49:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:50:22.106-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:50:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:50:52.399-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:50:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:51:22.661-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:51:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:51:52.819-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:51:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:52:23.095-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:52:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:52:53.338-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:52:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:53:23.512-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:53:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:53:53.933-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:53:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:54:24.213-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:54:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:54:54.477-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:54:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:55:24.685-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:55:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:55:54.952-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:55:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:56:25.174-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:56:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:56:55.479-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:56:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:57:25.753-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:57:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:57:56.033-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:57:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:58:26.323-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:58:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:58:56.577-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:58:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:59:26.712-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:59:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T13:59:56.920-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 13:59:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:00:27.227-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:00:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:00:57.493-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:00:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:01:27.727-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:01:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:01:57.931-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:01:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:02:28.093-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:02:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:02:58.360-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:02:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:03:28.547-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:03:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:03:58.817-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:03:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:04:29.076-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:04:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:04:59.326-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:04:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:05:29.624-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:05:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:05:59.897-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:05:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:06:30.246-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:06:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:07:00.515-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:07:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:07:30.795-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:07:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:08:01.034-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:08:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:08:31.272-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:08:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:09:01.517-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:09:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:09:31.796-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:09:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:10:01.972-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:10:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:10:32.142-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:10:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:11:02.447-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:11:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:11:32.740-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:11:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:12:03.128-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:12:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:12:33.423-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:12:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:13:03.641-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:13:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:13:33.921-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:13:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:14:04.203-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:14:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:14:34.372-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:14:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:15:04.661-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:15:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:15:34.923-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:15:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:16:05.088-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:16:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:16:35.365-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:16:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:17:05.542-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:17:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:17:35.746-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:17:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:18:06.035-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:18:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:18:36.302-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:18:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:19:06.557-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:19:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:19:36.828-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:19:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:20:07.119-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:20:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:20:37.427-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:20:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:21:07.586-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:21:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:21:37.968-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:21:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:22:08.172-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:22:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:22:38.396-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:22:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:23:08.676-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:23:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:23:38.829-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:23:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:24:09.071-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:24:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:24:39.479-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:24:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:25:09.759-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:25:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:25:40.043-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:25:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:26:10.292-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:26:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:26:40.632-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:26:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:27:10.937-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:27:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:27:41.200-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:27:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:28:11.456-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:28:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:28:41.617-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:28:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:29:11.861-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:29:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:29:42.126-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:29:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:30:12.274-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:30:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:30:42.685-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:30:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:31:12.912-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:31:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:31:43.088-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:31:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:32:13.355-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:32:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:32:43.668-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:32:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:33:13.874-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:33:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:33:44.120-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:33:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:34:14.414-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:34:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:34:44.701-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:34:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:35:14.977-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:35:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:35:45.313-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:35:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:36:15.810-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:36:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:36:46.087-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:36:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:37:16.375-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:37:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:37:46.596-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:37:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:38:16.767-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:38:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:38:46.909-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:38:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:39:17.191-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:39:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:39:47.603-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:39:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:40:17.927-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:40:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:40:48.229-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:40:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:41:18.518-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:41:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:41:48.825-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:41:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:42:18.960-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:42:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:42:49.158-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:42:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:43:19.561-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:43:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:43:49.867-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:43:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:44:20.122-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:44:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:44:50.277-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:44:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:45:20.443-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:45:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:45:50.754-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:45:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:46:20.942-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:46:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:46:51.226-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:46:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:47:21.487-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:47:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:47:51.695-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:47:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:48:22.139-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:48:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:48:52.442-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:48:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:49:22.841-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:49:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:49:53.093-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:49:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:50:23.451-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:50:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:50:53.615-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:50:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:51:23.888-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:51:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:51:54.163-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:51:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:52:24.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:52:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:52:54.656-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:52:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:53:24.953-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:53:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:53:55.195-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:53:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:54:25.471-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:54:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:54:55.750-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:54:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:55:26.047-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:55:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:55:56.345-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:55:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:56:26.534-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:56:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:56:56.798-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:56:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:57:27.130-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:57:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:57:57.480-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:57:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:58:27.620-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:58:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:58:57.839-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:58:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:59:28.114-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:59:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T14:59:58.420-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 14:59:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:00:28.721-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:00:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:00:58.908-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:00:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:01:29.189-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:01:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:01:59.463-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:01:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:02:29.760-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:02:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:03:00.048-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:02:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:03:30.329-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:03:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:04:00.658-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:04:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:04:30.901-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:04:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:05:01.167-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:05:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:05:31.353-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:05:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:06:01.555-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:06:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:06:31.908-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:06:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:07:02.169-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:07:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:07:32.492-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:07:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:08:02.777-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:08:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:08:33.065-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:08:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:09:03.441-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:09:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:09:33.720-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:09:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:10:04.279-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:10:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:10:34.572-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:10:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:11:04.869-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:11:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:11:35.249-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:11:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:12:05.459-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:12:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:12:35.735-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:12:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:13:06.010-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:13:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:13:36.306-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:13:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:14:06.633-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:14:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:14:36.959-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:14:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:15:07.154-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:15:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:15:37.419-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:15:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:16:07.706-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:16:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:16:37.907-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:16:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:17:08.205-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:17:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:17:38.355-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:17:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:18:08.567-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:18:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:18:38.857-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:18:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:19:09.101-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:19:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:19:39.427-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:19:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:20:09.707-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:20:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:20:39.957-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:20:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:21:10.257-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:21:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:21:40.618-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:21:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:22:10.795-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:22:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:22:41.003-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:22:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:23:11.273-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:23:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:23:41.562-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:23:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:24:11.693-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:24:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:24:42.061-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:24:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:25:12.434-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:25:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:25:42.614-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:25:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:26:12.906-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:26:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:26:43.090-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:26:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:27:13.449-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:27:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:27:43.604-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:27:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:28:13.853-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:28:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:28:44.097-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:28:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:29:14.426-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:29:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:29:44.843-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:29:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:30:15.143-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:30:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:30:45.501-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:30:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:31:15.780-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:31:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:31:45.972-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:31:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:32:16.390-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:32:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:32:46.863-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:32:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:33:17.135-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:33:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:33:47.383-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:33:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:34:17.683-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:34:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:34:48.023-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:34:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:35:18.296-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:35:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:35:48.587-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:35:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:36:18.852-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:36:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:36:49.128-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:36:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:37:19.287-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:37:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:37:49.565-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:37:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:38:19.841-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:38:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:38:50.107-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:38:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:39:20.432-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:39:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:39:50.698-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:39:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:40:20.919-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:40:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:40:51.322-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:40:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:41:21.596-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:41:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:41:51.876-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:41:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:42:22.174-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:42:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:42:52.461-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:42:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:43:22.780-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:43:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:43:53.054-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:43:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:44:23.409-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:44:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:44:53.706-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:44:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:45:23.985-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:45:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:45:54.316-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:45:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:46:24.577-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:46:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:46:54.852-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:46:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:47:25.128-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:47:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:47:55.400-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:47:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:48:25.669-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:48:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:48:55.849-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:48:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:49:26.220-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:49:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:49:56.489-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:49:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:50:26.849-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:50:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:50:57.141-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:50:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:51:27.461-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:51:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:51:57.598-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:51:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:52:28.122-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:52:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:52:58.490-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:52:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:53:28.807-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:53:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:53:59.087-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:53:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:54:29.357-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:54:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:54:59.649-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:54:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:55:29.941-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:55:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:56:00.188-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:55:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:56:30.376-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:56:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:57:00.625-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:57:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:57:31.059-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:57:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:58:01.401-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:58:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:58:31.537-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:58:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:59:01.706-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:59:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T15:59:31.996-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 15:59:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:00:02.300-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:00:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:00:32.524-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:00:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:01:02.778-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:01:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:01:33.068-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:01:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:02:03.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:02:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:02:33.625-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:02:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:03:03.920-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:03:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:03:34.279-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:03:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:04:04.602-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:04:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:04:34.876-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:04:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:05:05.155-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:05:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:05:35.494-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:05:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:06:05.836-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:06:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:06:36.103-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:06:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:07:06.406-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:07:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:07:36.808-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:07:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:08:07.082-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:08:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:08:37.371-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:08:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:09:07.568-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:09:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:09:37.855-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:09:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:10:08.136-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:10:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:10:38.520-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:10:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:11:08.730-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:11:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:11:38.958-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:11:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:12:09.110-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:12:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:12:39.262-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:12:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:13:09.502-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:13:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:13:39.847-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:13:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:14:10.076-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:14:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:14:40.362-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:14:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:15:10.727-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:15:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:15:41.183-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:15:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:16:11.424-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:16:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:16:41.680-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:16:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:17:11.956-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:17:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:17:42.153-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:17:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:18:12.297-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:18:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:18:42.633-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:18:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:19:12.801-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:19:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:19:43.081-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:19:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:20:13.523-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:20:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:20:43.831-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:20:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:21:14.123-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:21:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:21:44.340-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:21:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:22:14.627-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:22:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:22:44.966-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:22:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:23:15.259-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:23:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:23:45.609-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:23:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:24:15.759-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:24:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:24:45.977-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:24:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:25:16.280-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:25:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:25:46.453-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:25:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:26:16.734-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:26:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:26:47.025-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:26:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:27:17.261-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:27:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:27:47.572-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:27:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:28:17.851-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:28:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:28:48.270-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:28:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:29:18.553-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:29:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:29:48.902-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:29:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:30:19.182-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:30:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:30:49.389-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:30:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:31:19.586-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:31:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:31:49.885-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:31:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:32:20.157-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:32:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:32:50.444-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:32:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:33:20.730-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:33:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:33:50.903-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:33:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:34:21.059-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:34:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:34:51.316-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:34:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:35:21.592-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:35:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:35:51.868-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:35:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:36:22.146-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:36:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:36:52.448-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:36:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:37:22.636-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:37:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:37:52.887-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:37:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:38:23.166-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:38:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:38:53.401-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:38:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:39:23.674-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:39:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:39:53.957-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:39:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:40:24.275-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:40:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:40:54.416-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:40:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:41:24.565-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:41:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:41:54.932-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:41:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:42:25.207-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:42:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:42:55.467-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:42:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:43:25.734-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:43:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:43:56.101-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:43:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:44:26.406-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:44:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:44:56.677-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:44:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:45:27.060-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:45:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:45:57.336-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:45:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:46:27.655-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:46:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:46:57.968-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:46:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:47:28.293-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:47:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:47:58.526-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:47:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:48:28.856-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:48:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:48:59.129-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:48:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:49:29.440-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:49:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:49:59.699-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:49:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:50:30.129-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:50:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:51:00.433-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:51:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:51:30.745-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:51:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:52:01.010-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:52:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:52:31.286-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:52:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:53:01.514-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:53:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:53:31.769-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:53:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:54:02.150-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:54:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:54:32.416-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:54:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:55:02.680-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:55:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:55:32.876-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:55:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:56:03.209-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:56:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:56:33.497-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:56:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:57:03.772-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:57:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:57:33.935-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:57:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:58:04.119-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:58:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:58:34.281-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:58:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:59:04.471-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:59:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T16:59:34.745-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 16:59:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:00:04.938-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:00:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:00:35.242-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:00:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:01:05.603-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:01:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:01:35.861-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:01:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:02:06.196-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:02:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:02:36.496-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:02:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:03:06.791-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:03:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:03:37.128-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:03:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:04:07.395-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:04:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:04:37.604-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:04:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:05:07.924-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:05:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:05:38.074-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:05:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:06:08.372-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:06:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:06:38.636-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:06:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:07:08.835-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:07:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:07:39.067-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:07:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:08:09.197-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:08:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:08:39.391-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:08:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:09:09.774-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:09:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:09:40.070-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:09:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:10:10.360-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:10:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:10:40.673-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:10:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:11:11.132-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:11:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:11:41.458-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:11:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:12:11.848-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:12:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:12:42.163-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:12:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:13:12.465-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:13:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:13:42.754-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:13:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:14:13.082-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:14:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:14:43.324-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:14:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:15:13.469-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:15:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:15:43.734-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:15:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:16:14.021-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:16:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:16:44.306-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:16:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:17:14.575-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:17:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:17:44.783-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:17:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:18:15.025-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:18:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:18:45.289-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:18:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:19:15.554-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:19:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:19:45.850-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:19:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:20:16.091-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:20:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:20:46.293-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:20:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:21:16.564-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:21:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:21:46.850-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:21:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:22:16.989-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:22:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:22:47.229-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:22:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:23:17.717-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:23:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:23:48.012-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:23:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:24:18.426-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:24:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:24:48.577-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:24:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:25:18.847-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:25:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:25:49.020-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:25:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:26:19.346-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:26:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:26:49.634-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:26:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:27:19.934-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:27:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:27:50.223-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:27:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:28:20.560-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:28:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:28:50.779-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:28:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:29:21.071-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:29:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:29:51.408-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:29:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:30:21.645-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:30:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:30:51.980-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:30:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:31:22.214-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:31:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:31:52.545-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:31:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:32:22.864-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:32:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:32:53.482-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:32:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:33:23.769-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:33:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:33:54.054-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:33:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:34:24.207-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:34:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:34:54.385-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:34:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:35:24.716-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:35:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:35:55.009-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:35:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:36:25.283-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:36:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:36:55.440-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:36:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:37:25.742-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:37:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:37:56.069-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:37:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:38:26.346-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:38:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:38:56.505-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:38:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:39:26.852-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:39:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:39:57.117-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:39:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:40:27.390-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:40:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:40:57.666-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:40:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:41:27.929-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:41:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:41:58.330-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:41:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:42:28.539-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:42:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:42:58.815-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:42:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:43:29.109-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:43:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:43:59.303-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:43:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:44:29.580-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:44:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:44:59.850-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:44:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:45:30.139-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:45:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:46:00.424-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:46:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:46:30.683-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:46:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:47:00.827-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:47:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:47:31.138-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:47:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:48:01.329-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:48:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:48:31.594-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:48:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:49:01.938-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:49:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:49:32.228-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:49:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:50:02.486-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:50:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:50:32.742-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:50:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:51:03.017-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:51:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:51:33.395-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:51:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:52:03.763-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:52:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:52:34.032-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:52:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:53:04.199-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:53:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:53:34.374-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:53:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:54:04.668-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:54:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:54:34.947-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:54:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:55:05.207-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:55:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:55:35.512-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:55:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:56:05.773-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:56:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:56:35.916-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:56:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:57:06.205-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:57:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:57:36.613-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:57:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:58:06.790-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:58:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:58:37.078-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:58:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:59:07.398-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:59:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T17:59:37.630-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 17:59:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:00:07.873-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:00:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:00:38.137-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:00:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:01:08.426-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:01:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:01:38.725-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:01:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:02:09.016-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:02:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:02:39.227-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:02:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:03:09.722-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:03:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:03:39.921-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:03:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:04:10.218-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:04:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:04:40.425-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:04:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:05:10.681-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:05:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:05:41.212-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:05:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:06:11.496-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:06:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:06:41.771-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:06:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:07:11.914-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:07:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:07:42.049-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:07:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:08:12.343-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:08:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:08:42.623-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:08:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:09:12.885-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:09:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:09:43.157-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:09:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:10:13.417-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:10:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:10:43.709-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:10:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:11:14.001-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:11:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:11:44.305-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:11:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:12:14.650-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:12:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:12:44.802-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:12:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:13:15.183-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:13:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:13:45.613-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:13:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:14:15.907-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:14:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:14:46.216-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:14:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:15:16.481-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:15:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:15:46.764-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:15:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:16:17.068-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:16:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:16:47.341-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:16:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:17:17.628-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:17:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:17:47.887-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:17:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:18:18.166-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:18:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:18:48.501-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:18:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:19:18.785-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:19:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:19:49.088-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:19:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:20:19.338-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:20:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:20:49.599-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:20:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:21:19.885-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:21:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:21:50.171-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:21:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:22:20.374-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:22:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:22:50.645-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:22:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:23:20.923-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:23:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:23:51.237-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:23:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:24:21.530-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:24:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:24:51.720-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:24:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:25:22.014-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:25:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:25:52.160-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:25:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:26:22.442-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:26:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:26:52.841-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:26:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:27:23.113-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:27:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:27:53.350-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:27:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:28:23.581-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:28:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:28:53.930-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:28:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:29:24.236-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:29:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:29:54.496-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:29:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:30:24.640-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:30:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:30:54.884-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:30:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:31:25.044-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:31:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:31:55.317-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:31:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:32:25.610-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:32:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:32:55.886-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:32:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:33:26.219-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:33:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:33:56.490-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:33:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:34:26.849-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:34:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:34:57.142-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:34:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:35:27.423-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:35:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:35:57.772-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:35:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:36:28.181-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:36:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:36:58.375-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:36:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:37:28.519-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:37:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:37:58.818-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:37:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:38:29.193-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:38:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:38:59.522-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:38:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:39:29.672-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:39:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:39:59.954-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:39:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:40:30.224-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:40:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:41:00.504-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:41:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:41:30.674-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:41:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:42:00.883-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:42:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:42:31.102-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:42:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:43:01.367-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:43:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:43:31.628-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:43:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:44:01.988-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:44:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:44:32.261-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:44:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:45:02.551-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:45:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:45:32.801-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:45:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:46:03.095-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:46:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:46:33.365-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:46:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:47:03.751-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:47:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:47:34.092-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:47:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:48:04.226-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:48:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:48:34.600-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:48:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:49:04.866-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:49:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:49:35.192-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:49:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:50:05.364-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:50:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:50:35.638-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:50:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:51:05.937-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:51:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:51:36.214-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:51:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:52:06.502-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:52:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:52:36.828-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:52:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:53:07.093-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:53:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:53:37.370-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:53:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:54:07.662-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:54:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:54:37.955-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:54:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:55:08.252-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:55:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:55:38.512-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:55:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:56:08.703-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:56:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:56:38.888-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:56:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:57:09.190-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:57:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:57:39.568-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:57:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:58:09.843-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:58:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:58:40.118-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:58:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:59:10.400-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:59:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T18:59:40.704-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 18:59:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:00:11.017-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:00:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:00:41.327-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:00:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:01:11.611-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:01:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:01:41.903-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:01:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:02:12.188-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:02:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:02:42.485-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:02:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:03:12.767-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:03:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:03:43.027-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:03:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:04:13.307-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:04:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:04:43.472-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:04:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:05:13.849-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:05:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:05:44.110-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:05:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:06:14.252-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:06:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:06:44.542-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:06:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:07:14.925-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:07:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:07:45.218-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:07:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:08:15.500-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:08:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:08:45.845-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:08:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:09:16.145-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:09:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:09:46.295-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:09:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:10:16.609-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:10:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:10:46.869-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:10:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:11:17.138-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:11:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:11:47.419-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:11:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:12:17.680-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:12:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:12:47.957-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:12:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:13:18.239-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:13:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:13:48.497-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:13:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:14:18.780-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:14:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:14:49.069-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:14:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:15:19.387-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:15:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:15:49.589-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:15:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:16:19.881-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:16:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:16:50.138-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:16:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:17:20.492-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:17:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:17:50.642-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:17:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:18:20.966-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:18:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:18:51.389-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:18:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:19:21.647-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:19:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:19:51.909-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:19:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:20:22.173-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:20:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:20:52.338-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:20:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:21:22.766-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:21:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:21:53.034-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:21:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:22:23.309-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:22:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:22:53.444-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:22:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:23:23.705-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:23:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:23:53.912-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:23:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:24:24.251-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:24:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:24:54.520-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:24:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:25:24.855-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:25:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:25:55.130-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:25:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:26:25.283-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:26:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:26:55.572-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:26:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:27:25.708-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:27:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:27:55.996-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:27:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:28:26.280-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:28:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:28:56.574-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:28:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:29:26.865-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:29:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:29:57.062-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:29:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:30:27.377-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:30:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:30:57.712-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:30:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:31:28.005-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:31:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:31:58.298-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:31:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:32:28.508-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:32:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:32:58.815-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:32:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:33:29.097-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:33:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:33:59.360-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:33:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:34:29.670-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:34:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:34:59.966-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:34:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:35:30.134-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:35:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:36:00.473-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:36:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:36:30.733-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:36:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:37:01.016-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:37:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:37:31.308-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:37:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:38:01.693-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:38:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:38:31.986-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:38:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:39:02.264-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:39:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:39:32.586-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:39:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:40:02.955-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:40:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:40:33.247-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:40:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:41:03.540-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:41:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:41:33.824-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:41:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:42:04.245-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:42:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:42:34.433-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:42:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:43:04.615-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:43:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:43:34.982-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:43:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:44:05.153-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:44:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:44:35.452-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:44:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:45:05.729-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:45:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:45:35.887-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:45:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:46:06.160-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:46:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:46:36.426-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:46:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:47:06.740-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:47:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:47:37.075-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:47:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:48:07.461-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:48:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:48:37.824-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:48:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:49:08.116-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:49:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:49:38.409-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:49:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:50:08.656-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:50:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:50:39.059-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:50:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:51:09.345-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:51:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:51:39.633-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:51:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:52:09.903-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:52:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:52:40.086-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:52:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:53:10.232-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:53:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:53:40.577-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:53:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:54:10.868-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:54:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:54:41.220-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:54:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:55:11.518-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:55:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:55:41.695-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:55:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:56:11.973-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:56:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:56:42.240-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:56:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:57:12.548-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:57:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:57:42.827-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:57:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:58:13.176-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:58:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:58:43.372-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:58:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:59:14.099-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:59:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T19:59:44.263-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 19:59:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:00:14.405-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:00:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:00:44.643-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:00:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:01:14.925-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:01:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:01:45.125-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:01:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:02:15.426-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:02:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:02:45.700-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:02:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:03:16.064-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:03:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:03:46.221-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:03:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:04:16.384-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:04:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:04:46.596-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:04:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:05:16.879-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:05:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:05:47.189-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:05:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:06:17.457-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:06:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:06:47.597-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:06:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:07:17.902-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:07:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:07:48.292-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:07:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:08:18.568-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:08:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:08:48.835-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:08:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:09:19.116-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:09:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:09:49.319-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:09:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:10:19.568-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:10:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:10:49.859-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:10:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:11:20.007-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:11:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:11:50.335-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:11:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:12:20.515-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:12:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:12:50.651-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:12:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:13:20.938-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:13:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:13:51.224-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:13:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:14:21.378-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:14:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:14:51.827-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:14:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:15:22.125-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:15:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:15:52.420-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:15:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:16:22.767-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:16:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:16:53.040-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:16:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:17:23.381-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:17:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:17:53.670-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:17:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:18:23.961-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:18:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:18:54.092-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:18:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:19:24.405-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:19:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:19:54.646-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:19:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:20:24.917-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:20:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:20:55.101-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:20:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:21:25.273-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:21:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:21:55.610-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:21:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:22:25.858-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:22:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:22:56.120-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:22:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:23:26.295-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:23:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:23:56.612-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:23:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:24:26.805-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:24:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:24:57.198-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:24:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:25:27.505-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:25:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:25:57.689-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:25:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:26:28.027-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:26:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:26:58.326-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:26:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:27:28.616-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:27:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:27:58.926-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:27:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:28:29.216-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:28:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:28:59.427-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:28:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:29:29.630-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:29:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:29:59.772-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:29:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:30:29.921-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:30:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:31:00.105-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:30:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:31:30.386-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:31:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:32:00.697-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:32:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:32:30.842-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:32:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:33:01.088-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:33:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:33:31.410-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:33:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:34:01.689-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:34:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:34:31.936-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:34:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:35:02.103-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:35:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:35:32.377-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:35:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:36:02.661-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:36:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:36:32.923-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:36:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:37:03.116-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:37:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:37:33.406-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:37:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:38:03.670-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:38:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:38:33.944-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:38:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:39:04.226-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:39:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:39:34.499-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:39:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:40:04.835-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:40:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:40:35.014-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:40:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:41:05.288-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:41:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:41:35.570-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:41:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:42:05.873-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:42:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:42:36.043-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:42:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:43:06.347-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:43:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:43:36.623-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:43:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:44:06.809-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:44:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:44:37.151-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:44:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:45:07.417-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:45:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:45:37.770-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:45:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:46:07.966-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:46:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:46:38.180-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:46:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:47:08.606-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:47:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:47:38.799-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:47:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:48:09.076-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:48:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:48:39.336-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:48:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:49:09.600-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:49:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:49:39.885-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:49:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:50:10.074-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:50:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:50:40.336-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:50:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:51:10.612-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:51:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:51:40.787-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:51:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:52:11.073-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:52:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:52:41.220-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:52:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:53:11.478-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:53:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:53:41.792-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:53:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:54:12.093-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:54:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:54:42.370-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:54:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:55:12.651-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:55:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:55:42.918-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:55:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:56:13.282-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:56:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:56:43.708-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:56:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:57:14.004-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:57:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:57:44.307-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:57:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:58:14.590-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:58:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:58:44.790-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:58:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:59:16.127-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:59:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T20:59:46.379-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 20:59:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:00:16.627-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:00:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:00:46.906-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:00:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:01:17.203-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:01:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:01:47.498-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:01:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:02:17.733-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:02:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:02:47.876-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:02:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:03:18.163-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:03:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:03:48.404-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:03:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:04:18.692-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:04:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:04:48.974-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:04:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:05:19.243-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:05:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:05:49.552-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:05:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:06:19.835-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:06:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:06:50.128-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:06:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:07:20.411-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:07:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:07:50.614-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:07:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:08:20.902-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:08:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:08:51.061-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:08:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:09:21.460-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:09:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:09:51.680-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:09:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:10:21.841-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:10:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:10:52.128-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:10:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:11:22.479-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:11:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:11:52.750-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:11:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:12:23.017-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:12:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:12:53.250-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:12:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:13:23.553-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:13:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:13:53.690-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:13:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:14:23.876-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:14:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:14:54.152-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:14:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:15:24.599-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:15:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:15:54.864-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:15:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:16:25.146-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:16:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:16:55.497-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:16:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:17:25.774-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:17:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:17:56.038-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:17:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:18:26.297-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:18:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:18:56.570-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:18:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:19:26.826-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:19:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:19:57.091-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:19:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:20:27.388-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:20:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:20:57.672-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:20:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:21:27.928-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:21:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:21:58.112-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:21:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:22:28.326-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:22:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:22:58.603-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:22:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:23:28.900-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:23:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:23:59.172-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:23:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:24:29.366-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:24:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:24:59.671-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:24:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:25:29.971-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:25:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:26:00.466-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:25:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:26:30.700-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:26:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:27:00.966-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:27:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:27:31.231-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:27:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:28:01.567-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:28:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:28:31.765-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:28:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:29:02.061-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:29:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:29:32.296-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:29:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:30:02.638-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:30:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:30:32.775-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:30:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:31:03.042-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:31:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:31:33.321-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:31:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:32:03.667-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:32:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:32:34.022-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:32:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:33:04.183-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:33:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:33:34.454-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:33:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:34:04.783-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:34:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:34:35.061-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:34:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:35:05.356-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:35:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:35:35.679-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:35:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:36:05.954-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:36:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:36:36.096-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:36:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:37:06.325-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:37:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:37:36.616-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:37:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:38:06.896-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:38:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:38:37.164-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:38:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:39:07.430-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:39:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:39:37.688-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:39:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:40:07.960-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:40:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:40:38.155-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:40:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:41:08.357-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:41:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:41:38.631-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:41:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:42:08.923-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:42:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:42:39.179-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:42:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:43:09.514-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:43:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:43:39.689-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:43:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:44:09.983-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:44:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:44:40.363-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:44:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:45:10.656-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:45:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:45:40.937-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:45:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:46:11.316-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:46:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:46:41.675-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:46:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:47:11.968-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:47:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:47:42.161-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:47:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:48:12.439-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:48:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:48:42.689-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:48:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:49:13.074-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:49:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:49:43.309-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:49:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:50:13.575-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:50:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:50:43.964-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:50:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:51:14.126-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:51:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:51:44.462-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:51:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:52:14.745-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:52:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:52:45.020-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:52:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:53:15.370-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:53:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:53:45.649-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:53:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:54:15.944-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:54:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:54:46.200-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:54:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:55:16.492-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:55:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:55:46.646-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:55:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:56:16.816-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:56:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:56:47.130-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:56:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:57:17.423-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:57:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:57:47.580-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:57:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:58:17.870-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:58:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:58:48.100-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:58:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:59:18.377-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:59:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T21:59:48.652-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 21:59:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:00:18.817-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:00:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:00:49.020-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:00:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:01:19.309-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:01:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:01:49.602-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:01:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:02:19.870-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:02:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:02:50.231-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:02:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:03:20.542-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:03:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:03:50.928-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:03:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:04:21.231-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:04:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:04:51.503-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:04:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:05:21.789-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:05:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:05:52.141-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:05:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:06:22.423-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:06:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:06:52.726-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:06:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:07:23.016-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:07:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:07:53.225-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:07:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:08:23.530-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:08:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:08:53.818-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:08:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:09:24.106-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:09:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:09:54.357-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:09:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:10:24.619-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:10:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:10:54.983-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:10:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:11:25.250-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:11:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:11:55.628-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:11:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:12:25.903-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:12:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:12:56.309-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:12:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:13:26.599-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:13:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:13:56.907-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:13:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:14:27.162-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:14:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:14:57.360-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:14:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:15:27.581-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:15:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:15:57.896-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:15:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:16:28.268-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:16:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:16:58.603-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:16:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:17:28.895-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:17:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:17:59.168-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:17:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:18:29.383-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:18:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:18:59.619-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:18:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:19:29.871-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:19:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:20:00.278-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:19:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:20:30.571-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:20:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:21:00.762-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:21:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:21:31.068-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:21:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:22:01.317-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:22:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:22:31.610-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:22:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:23:01.915-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:23:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:23:32.102-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:23:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:24:02.393-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:24:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:24:32.655-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:24:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:25:02.833-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:25:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:25:33.173-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:25:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:26:03.429-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:26:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:26:33.604-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:26:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:27:03.845-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:27:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:27:34.168-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:27:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:28:04.447-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:28:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:28:34.736-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:28:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:29:05.029-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:29:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:29:35.305-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:29:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:30:05.441-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:30:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:30:35.630-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:30:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:31:05.782-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:31:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:31:36.056-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:31:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:32:06.320-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:32:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:32:36.808-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:32:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:33:07.077-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:33:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:33:37.371-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:33:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:34:07.618-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:34:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:34:37.879-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:34:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:35:08.174-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:35:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:35:38.429-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:35:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:36:08.748-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:36:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:36:38.992-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:36:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:37:09.278-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:37:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:37:39.424-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:37:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:38:09.674-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:38:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:38:39.840-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:38:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:39:10.116-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:39:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:39:40.426-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:39:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:40:10.699-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:40:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:40:41.077-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:40:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:41:11.490-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:41:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:41:41.759-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:41:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:42:12.133-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:42:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:42:42.384-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:42:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:43:12.736-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:43:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:43:43.013-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:43:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:44:13.261-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:44:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:44:43.559-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:44:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:45:13.961-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:45:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:45:44.261-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:45:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:46:14.553-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:46:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:46:44.762-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:46:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:47:15.124-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:47:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:47:45.419-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:47:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:48:15.709-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:48:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:48:46.017-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:48:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:49:16.317-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:49:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:49:46.629-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:49:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:50:16.889-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:50:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:50:47.280-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:50:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:51:17.517-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:51:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:51:47.787-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:51:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:52:18.072-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:52:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:52:48.357-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:52:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:53:18.624-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:53:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:53:48.942-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:53:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:54:19.245-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:54:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:54:49.572-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:54:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:55:19.761-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:55:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:55:49.964-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:55:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:56:20.121-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:56:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:56:50.513-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:56:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:57:20.799-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:57:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:57:51.167-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:57:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:58:21.445-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:58:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:58:51.724-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:58:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:59:21.988-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:59:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T22:59:52.272-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 22:59:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:00:22.577-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:00:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:00:52.721-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:00:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:01:22.976-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:01:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:01:53.408-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:01:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:02:23.702-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:02:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:02:53.998-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:02:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:03:24.258-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:03:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:03:54.488-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:03:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:04:24.767-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:04:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:04:54.957-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:04:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:05:25.161-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:05:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:05:55.401-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:05:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:06:25.678-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:06:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:06:55.852-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:06:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:07:26.089-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:07:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:07:56.388-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:07:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:08:26.720-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:08:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:08:56.876-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:08:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:09:27.141-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:09:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:09:57.302-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:09:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:10:27.554-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:10:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:10:57.856-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:10:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:11:28.139-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:11:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:11:58.414-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:11:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:12:28.709-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:12:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:12:59.074-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:12:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:13:29.426-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:13:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:13:59.720-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:13:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:14:29.965-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:14:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:15:00.247-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:14:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:15:30.522-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:15:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:16:00.829-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:16:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:16:31.105-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:16:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:17:01.358-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:17:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:17:31.618-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:17:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:18:01.912-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:18:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:18:32.195-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:18:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:19:02.491-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:19:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:19:32.731-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:19:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:20:02.966-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:20:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:20:33.246-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:20:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:21:03.660-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:21:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:21:33.803-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:21:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:22:04.083-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:22:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:22:34.542-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:22:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:23:04.813-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:23:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:23:35.026-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:23:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:24:05.288-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:24:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:24:35.568-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:24:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:25:05.858-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:25:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:25:36.234-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:25:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:26:06.558-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:26:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:26:36.836-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:26:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:27:07.177-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:27:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:27:37.403-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:27:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:28:07.669-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:28:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:28:37.821-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:28:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:29:08.144-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:29:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:29:38.337-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:29:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:30:08.648-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:30:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:30:38.839-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:30:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:31:09.121-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:31:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:31:39.544-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:31:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:32:09.959-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:32:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:32:40.243-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:32:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:33:10.436-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:33:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:33:40.623-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:33:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:34:10.866-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:34:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:34:41.146-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:34:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:35:11.537-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:35:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:35:41.812-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:35:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:36:11.952-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:36:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:36:42.235-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:36:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:37:12.491-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:37:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:37:42.775-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:37:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:38:13.005-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:38:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:38:43.281-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:38:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:39:13.543-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:39:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:39:43.890-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:39:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:40:14.191-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:40:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:40:44.479-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:40:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:41:14.674-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:41:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:41:44.905-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:41:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:42:15.192-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:42:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:42:45.566-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:42:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:43:15.858-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:43:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:43:46.128-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:43:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:44:16.412-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:44:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:44:46.713-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:44:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:45:16.869-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:45:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:45:47.030-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:45:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:46:17.252-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:46:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:46:47.538-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:46:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:47:17.669-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:47:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:47:47.943-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:47:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:48:18.172-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:48:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:48:48.373-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:48:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:49:18.553-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:49:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:49:48.742-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:49:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:50:19.044-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:50:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:50:49.328-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:50:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:51:19.514-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:51:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:51:49.791-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:51:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:52:20.070-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:52:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:52:50.339-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:52:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:53:20.710-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:53:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:53:51.048-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:53:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:54:21.313-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:54:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:54:51.454-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:54:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:55:21.736-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:55:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:55:52.016-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:55:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:56:22.265-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:56:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:56:52.548-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:56:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:57:22.826-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:57:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:57:53.019-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:57:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:58:23.300-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:58:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:58:53.575-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:58:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:59:23.858-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:59:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-22T23:59:54.103-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 22 23:59:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:00:24.400-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:00:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:00:54.790-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:00:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:01:25.059-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:01:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:01:55.264-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:01:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:02:25.656-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:02:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:02:55.804-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:02:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:03:26.097-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:03:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:03:56.367-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:03:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:04:26.643-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:04:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:04:56.802-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:04:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:05:10.787-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T00:05:10.787-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T00:05:16.976-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T00:05:16.976-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T00:05:27.067-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:05:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:05:57.314-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:05:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:06:27.562-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:06:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:06:57.846-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:06:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:07:27.998-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:07:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:07:58.266-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:07:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:08:28.555-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:08:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:08:58.843-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:08:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:09:28.995-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:09:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:09:59.388-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:09:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:10:29.668-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:10:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:10:59.959-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:10:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:11:30.167-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:11:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:12:00.383-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:12:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:12:30.740-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:12:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:13:01.030-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:13:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:13:31.458-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:13:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:14:01.749-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:14:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:14:31.961-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:14:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:15:02.232-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:15:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:15:32.518-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:15:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:16:02.668-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:16:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:16:32.992-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:16:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:17:03.151-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:17:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:17:33.670-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:17:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:18:03.848-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:18:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:18:34.101-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:18:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:19:04.308-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:19:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:19:34.553-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:19:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:20:04.916-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:20:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:20:35.335-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:20:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:21:05.594-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:21:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:21:35.954-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:21:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:22:06.366-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:22:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:22:36.668-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:22:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:23:06.850-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:23:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:23:37.126-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:23:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:24:07.359-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:24:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:24:37.649-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:24:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:24:43.038-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T00:24:43.038-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T00:24:49.264-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T00:24:49.264-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T00:25:01.584-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T00:25:01.584-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T00:25:07.924-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:25:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:25:38.174-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:25:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:26:08.456-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:26:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:26:38.754-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:26:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:27:08.883-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:27:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:27:39.181-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:27:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:28:09.449-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:28:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:28:39.896-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:28:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:29:10.149-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:29:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:29:40.508-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:29:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:30:10.700-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:30:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:30:41.143-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:30:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:31:11.409-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:31:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:31:41.689-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:31:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:32:12.003-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:32:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:32:42.311-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:32:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:33:12.577-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:33:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:33:42.973-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:33:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:34:13.259-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:34:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:34:43.453-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:34:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:35:13.717-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:35:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:35:44.097-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:35:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:36:14.453-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:36:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:36:44.600-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:36:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:37:14.877-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:37:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:37:45.249-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:37:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:38:15.458-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:38:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:38:45.862-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:38:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:39:16.138-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:39:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:39:46.454-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:39:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:40:16.735-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:40:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:40:47.014-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:40:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:41:17.307-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:41:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:41:47.592-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:41:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:42:17.845-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:42:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:42:48.213-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:42:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:43:18.460-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:43:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:43:27.239-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588597fe9527cdec667c0e94 2017-01-23T00:43:27.817-0500 [Balancer] ChunkManager: time to load chunks for historyDb.History: 102ms sequenceNumber: 4 version: 3281|1||55c0dbaf5b591f0b0cfcee5f based on: 3272|51||55c0dbaf5b591f0b0cfcee5f 2017-01-23T00:43:28.015-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-23T00:43:48.669-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:43:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:44:18.960-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:44:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:44:49.245-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:44:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:45:19.509-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:45:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:45:49.734-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:45:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:46:20.028-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:46:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:46:50.329-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:46:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:47:20.600-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:47:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:47:50.874-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:47:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:48:21.160-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:48:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:48:51.323-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:48:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:49:21.570-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:49:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:49:51.819-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:49:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:50:22.142-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:50:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:50:52.298-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:50:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:51:22.525-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:51:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:51:52.816-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:51:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:52:23.079-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:52:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:52:53.231-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:52:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:53:23.458-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:53:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:53:53.628-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:53:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:54:17.893-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T00:54:17.893-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T00:54:23.785-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:54:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:54:24.048-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T00:54:24.048-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T00:54:48.492-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T00:54:48.492-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T00:54:54.142-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:54:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:55:24.430-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:55:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:55:37.252-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T00:55:37.252-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T00:55:54.719-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:55:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:56:13.798-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T00:56:13.798-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T00:56:25.075-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:56:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:56:55.371-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:56:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:57:14.859-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T00:57:14.859-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T00:57:25.635-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:57:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:57:55.901-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:57:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:58:26.056-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:58:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:58:56.311-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:58:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:59:26.590-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:59:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T00:59:56.779-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 00:59:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:00:27.100-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:00:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:00:57.484-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:00:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:01:27.871-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:01:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:01:58.169-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:01:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:02:28.452-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:02:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:02:58.731-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:02:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:03:29.020-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:03:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:03:59.396-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:03:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:04:29.654-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:04:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:04:59.955-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:04:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:05:30.241-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:05:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:06:00.557-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:06:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:06:30.711-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:06:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:07:00.959-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:07:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:07:31.115-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:07:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:08:01.395-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:08:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:08:31.685-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:08:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:09:01.951-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:09:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:09:32.223-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:09:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:09:41.581-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:09:41.581-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:10:02.511-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:10:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:10:06.129-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:10:06.129-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:10:12.332-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:10:12.332-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:10:24.635-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58859e509527cdec667c0e9e 2017-01-23T01:10:25.156-0500 [Balancer] ChunkManager: time to load chunks for historyDb.History: 90ms sequenceNumber: 5 version: 3285|1||55c0dbaf5b591f0b0cfcee5f based on: 3281|1||55c0dbaf5b591f0b0cfcee5f 2017-01-23T01:10:25.305-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-23T01:10:32.778-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:10:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:10:43.777-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:10:43.778-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:10:56.076-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:10:56.076-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:11:03.037-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:11:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:11:32.651-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:11:32.651-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:11:33.230-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:11:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:11:57.025-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:11:57.026-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:12:03.538-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:12:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:12:15.277-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:12:15.278-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:12:33.816-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:12:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:13:04.126-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:13:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:13:34.272-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('58859f0d60734f9d7b221566') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485152014133), why: "doing balance round", ts: ObjectId('58859f0e9527cdec667c0ea4') } } gle1: { lastOp: Timestamp 1485152014000|9, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 14, writtenTo: null, err: null, waited: 14, ok: 1.0 } gle2: { lastOp: Timestamp 1485151825000|4, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 17, writtenTo: null, err: null, waited: 17, ok: 1.0 } 2017-01-23T01:13:34.359-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-23T01:13:34.415-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:13:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:13:34.524-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58859f0e9527cdec667c0ea4 2017-01-23T01:13:35.007-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-23T01:14:04.623-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:14:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:14:05.511-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58859f2d9527cdec667c0ea5 2017-01-23T01:14:06.189-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-23T01:14:18.615-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58859f3a9527cdec667c0ea6 2017-01-23T01:14:19.282-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-23T01:14:34.835-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:14:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:15:05.133-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:15:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:15:08.157-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58859f6b9527cdec667c0ea7 2017-01-23T01:15:08.753-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-23T01:15:35.287-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:15:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:16:05.563-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:16:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:16:21.862-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:16:21.862-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:16:34.210-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:16:34.210-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:16:35.842-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:16:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:16:46.540-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:16:46.540-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:16:58.886-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58859fda9527cdec667c0eab 2017-01-23T01:16:59.510-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-23T01:17:06.136-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:17:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:17:18.004-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58859fed9527cdec667c0eac 2017-01-23T01:17:18.557-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-23T01:17:36.282-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:17:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:17:43.072-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:17:43.072-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:18:06.435-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:18:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:18:07.681-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5885a01f9527cdec667c0eae 2017-01-23T01:18:08.352-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-23T01:18:26.882-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5885a0329527cdec667c0eaf 2017-01-23T01:18:27.554-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-23T01:18:36.729-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:18:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:19:04.216-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5885a0579527cdec667c0eb0 2017-01-23T01:19:04.812-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-23T01:19:07.067-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:19:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:19:11.047-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:19:11.047-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:19:37.260-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:19:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:20:07.545-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:20:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:20:37.794-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:20:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:21:08.091-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:21:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:21:24.662-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:21:24.662-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:21:38.378-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:21:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:22:01.340-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:22:01.340-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:22:07.718-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5885a10f9527cdec667c0eb4 2017-01-23T01:22:08.528-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-23T01:22:08.707-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:22:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:22:20.793-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:22:20.794-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:22:39.073-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:22:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:22:39.215-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:22:39.216-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:23:09.365-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:23:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:23:15.791-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:23:15.791-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:23:28.053-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:23:28.053-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:23:39.669-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:23:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:23:40.355-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:23:40.355-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:23:52.726-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:23:52.726-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:24:09.944-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:24:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:24:23.198-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:24:23.198-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:24:40.218-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:24:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:24:41.760-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5885a1a99527cdec667c0ebc 2017-01-23T01:24:42.391-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-23T01:25:00.863-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:25:00.863-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:25:10.347-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:25:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:25:40.608-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:25:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:25:49.847-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5885a1ed9527cdec667c0ebe 2017-01-23T01:25:50.447-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-23T01:26:10.898-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:26:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:26:14.855-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:26:14.856-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:26:41.206-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:26:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:26:51.527-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:26:51.527-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:27:11.555-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:27:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:27:34.362-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5885a2569527cdec667c0ec1 2017-01-23T01:27:34.960-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-23T01:27:41.861-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:27:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:28:12.139-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:28:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:28:35.906-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5885a292b3cf2809cb161b8e') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485152915843), why: "doing balance round", ts: ObjectId('5885a2939527cdec667c0ec2') } } gle1: { lastOp: Timestamp 1485152854000|36, connectionId: 21778, updatedExisting: false, n: 0, syncMillis: 17, writtenTo: null, err: null, waited: 17, ok: 1.0 } gle2: { lastOp: Timestamp 1485152915000|36, connectionId: 6379656, updatedExisting: true, n: 1, syncMillis: 6, writtenTo: null, err: null, waited: 6, ok: 1.0 } 2017-01-23T01:28:35.916-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-23T01:28:35.982-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5885a2939527cdec667c0ec2 2017-01-23T01:28:36.647-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-23T01:28:42.489-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:28:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:28:43.057-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5885a29a9527cdec667c0ec3 2017-01-23T01:28:43.757-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-23T01:28:56.065-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:28:56.065-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:29:12.823-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:29:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:29:20.536-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5885a2c09527cdec667c0ec5 2017-01-23T01:29:21.171-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-23T01:29:39.614-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5885a2d39527cdec667c0ec6 2017-01-23T01:29:40.246-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-23T01:29:43.131-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:29:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:29:52.588-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5885a2dfca3906e0a9d42284') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485152992438), why: "doing balance round", ts: ObjectId('5885a2e09527cdec667c0ec7') } } gle1: { lastOp: Timestamp 1485152992000|12, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 15, writtenTo: null, err: null, waited: 15, ok: 1.0 } gle2: { lastOp: Timestamp 1485152980000|6, connectionId: 393608, updatedExisting: false, n: 0, syncMillis: 21, writtenTo: null, err: null, waited: 21, ok: 1.0 } 2017-01-23T01:29:52.595-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-23T01:29:52.595-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:30:13.516-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:30:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:30:13.516-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-23T01:30:13.664-0500 [LockPinger] handled late remove of old distributed lock with ts 5885a2e09527cdec667c0ec7 2017-01-23T01:30:35.217-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5885a30b9527cdec667c0ec8 2017-01-23T01:30:35.749-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-23T01:30:42.099-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5885a3119527cdec667c0ec9 2017-01-23T01:30:42.676-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-23T01:30:43.951-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:30:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:30:55.106-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5885a31e9527cdec667c0eca 2017-01-23T01:30:55.809-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-23T01:31:02.145-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5885a3259527cdec667c0ecb 2017-01-23T01:31:02.772-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-23T01:31:09.050-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5885a32c9527cdec667c0ecc 2017-01-23T01:31:09.654-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-23T01:31:14.271-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:31:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:31:16.005-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5885a3339527cdec667c0ecd 2017-01-23T01:31:16.677-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-23T01:31:23.033-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5885a33a9527cdec667c0ece 2017-01-23T01:31:23.736-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-23T01:31:44.523-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:31:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:32:00.404-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5885a3609527cdec667c0ecf 2017-01-23T01:32:00.894-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-23T01:32:07.231-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5885a3669527cdec667c0ed0 2017-01-23T01:32:07.795-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-23T01:32:14.857-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:32:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:32:32.322-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:32:32.322-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:32:45.235-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:32:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:32:50.672-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:32:50.672-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:33:15.144-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:33:15.144-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:33:15.424-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:33:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:33:21.467-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:33:21.467-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:33:45.719-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:33:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:33:45.867-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:33:45.867-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:33:58.279-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:33:58.279-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:34:16.003-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:34:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:34:16.583-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:34:16.583-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:34:34.955-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:34:34.955-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:34:46.265-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:34:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:34:47.165-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:34:47.165-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:34:53.518-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5885a40d9527cdec667c0eda 2017-01-23T01:34:54.177-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-23T01:35:16.405-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:35:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:35:18.609-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5885a42560734f9d7b221584') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485153318471), why: "doing balance round", ts: ObjectId('5885a4269527cdec667c0edb') } } gle1: { lastOp: Timestamp 1485153318000|14, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 19, writtenTo: null, err: null, waited: 19, ok: 1.0 } gle2: { lastOp: Timestamp 1485153294000|1, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 22, writtenTo: null, err: null, waited: 22, ok: 1.0 } 2017-01-23T01:35:18.616-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-23T01:35:18.616-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:35:24.891-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:35:24.891-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:35:46.562-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:35:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:35:46.562-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-23T01:35:46.630-0500 [LockPinger] handled late remove of old distributed lock with ts 5885a4269527cdec667c0edb 2017-01-23T01:36:17.005-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:36:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:36:19.658-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:36:19.658-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:36:47.298-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:36:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:37:17.510-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:37:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:37:47.713-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:37:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:38:15.250-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5885a4d69527cdec667c0ede 2017-01-23T01:38:15.919-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-23T01:38:17.948-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:38:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:38:48.253-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:38:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:38:58.933-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5885a5029527cdec667c0edf 2017-01-23T01:38:59.495-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-23T01:39:18.466-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:39:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:39:48.762-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:39:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:40:00.259-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:40:00.259-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:40:19.046-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:40:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:40:49.161-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:40:49.161-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:40:49.333-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:40:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:41:19.523-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:41:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:41:37.928-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:41:37.928-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:41:44.135-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:41:44.135-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:41:49.788-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:41:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:41:56.368-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:41:56.368-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:42:08.620-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:42:08.620-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:42:14.870-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5885a5c69527cdec667c0ee6 2017-01-23T01:42:15.474-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-23T01:42:20.081-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:42:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:42:34.062-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5885a5d99527cdec667c0ee7 2017-01-23T01:42:34.672-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-23T01:42:47.090-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5885a5e69527cdec667c0ee8 2017-01-23T01:42:47.724-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-23T01:42:50.245-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:42:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:42:54.123-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5885a5ed9527cdec667c0ee9 2017-01-23T01:42:54.794-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-23T01:43:20.500-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:43:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:43:31.448-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:43:31.448-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:43:37.666-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:43:37.667-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:43:43.874-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:43:43.874-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:43:50.807-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:43:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:44:02.180-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:44:02.180-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:44:08.376-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:44:08.376-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:44:20.974-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:44:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:44:26.676-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:44:26.676-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:44:51.340-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:44:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:45:03.230-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:45:03.230-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:45:21.486-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:45:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:45:39.756-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:45:39.756-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:45:51.857-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:45:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:45:51.969-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:45:51.969-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:46:22.165-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:46:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:46:52.458-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:46:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:46:53.346-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5885a6dc9527cdec667c0ef3 2017-01-23T01:46:54.082-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-23T01:47:22.750-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:47:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:47:43.103-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5885a70e9527cdec667c0ef4 2017-01-23T01:47:43.659-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-23T01:47:53.054-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:47:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:48:23.328-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:48:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:48:53.635-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:48:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:49:02.864-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5885a75e9527cdec667c0ef5 2017-01-23T01:49:03.534-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-23T01:49:22.052-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5885a7719527cdec667c0ef6 2017-01-23T01:49:22.758-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-23T01:49:23.801-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:49:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:49:54.085-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:49:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:50:24.366-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:50:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:50:29.558-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:50:29.558-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:50:54.696-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:50:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:51:06.130-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:51:06.130-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:51:25.149-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:51:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:51:55.361-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:51:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:52:25.318-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:52:25.318-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:52:25.564-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:52:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:52:31.502-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:52:31.502-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:52:55.869-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:52:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:53:14.226-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:53:14.226-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:53:26.151-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:53:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:53:32.503-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:53:32.503-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:53:56.394-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:53:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:54:26.680-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:54:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:54:56.890-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:54:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:55:09.960-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:55:09.960-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:55:27.229-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:55:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:55:57.524-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:55:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:56:04.699-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:56:04.699-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:56:27.815-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:56:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:56:35.191-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:56:35.191-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:56:58.014-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:56:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:56:59.575-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:56:59.575-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:57:28.315-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:57:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:57:58.562-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:57:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:58:00.451-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:58:00.451-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:58:06.655-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5885a97e9527cdec667c0f02 2017-01-23T01:58:07.284-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-23T01:58:13.653-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5885a9859527cdec667c0f03 2017-01-23T01:58:14.291-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-23T01:58:20.493-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-23T01:58:20.493-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-23T01:58:28.756-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:58:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:58:38.964-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5885a99e9527cdec667c0f05 2017-01-23T01:58:39.487-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-23T01:58:45.879-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5885a9a59527cdec667c0f06 2017-01-23T01:58:46.563-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-23T01:58:58.940-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:58:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:59:29.128-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:59:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T01:59:29.205-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5885a9d09527cdec667c0f07 2017-01-23T01:59:29.802-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-23T01:59:48.284-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5885a9e39527cdec667c0f08 2017-01-23T01:59:48.943-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-23T01:59:55.299-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5885a9eb9527cdec667c0f09 2017-01-23T01:59:56.002-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-23T01:59:59.401-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 01:59:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:00:29.631-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:00:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:00:59.937-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:00:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:01:30.138-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:01:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:02:00.470-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:02:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:02:30.765-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:02:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:03:00.936-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:03:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:03:31.137-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:03:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:04:01.292-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:04:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:04:31.429-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:04:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:05:01.704-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:05:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:05:32.014-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:05:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:06:02.274-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:06:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:06:32.655-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:06:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:07:02.939-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:07:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:07:33.196-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:07:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:08:03.490-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:08:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:08:33.649-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:08:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:09:04.019-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:09:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:09:34.181-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:09:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:10:04.496-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:10:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:10:34.785-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:10:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:11:05.018-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:11:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:11:35.302-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:11:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:12:05.502-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:12:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:12:35.799-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:12:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:13:06.060-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:13:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:13:36.434-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:13:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:14:06.727-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:14:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:14:36.988-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:14:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:15:07.250-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:15:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:15:37.514-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:15:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:16:07.872-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:16:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:16:38.140-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:16:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:17:08.543-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:17:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:17:38.688-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:17:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:18:09.003-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:18:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:18:39.353-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:18:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:19:09.648-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:19:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:19:39.831-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:19:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:20:09.984-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:20:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:20:40.288-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:20:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:21:10.602-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:21:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:21:40.839-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:21:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:22:11.112-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:22:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:22:41.419-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:22:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:23:11.733-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:23:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:23:41.991-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:23:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:24:12.258-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:24:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:24:42.594-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:24:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:25:12.848-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:25:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:25:43.119-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:25:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:26:13.449-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:26:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:26:43.881-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:26:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:27:14.180-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:27:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:27:44.455-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:27:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:28:14.726-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:28:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:28:45.053-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:28:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:29:15.207-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:29:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:29:45.501-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:29:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:30:15.685-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:30:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:30:46.023-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:30:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:31:16.314-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:31:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:31:46.627-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:31:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:32:17.097-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:32:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:32:47.326-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:32:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:33:17.588-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:33:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:33:47.873-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:33:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:34:18.080-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:34:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:34:48.277-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:34:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:35:18.563-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:35:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:35:48.849-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:35:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:36:19.114-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:36:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:36:49.284-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:36:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:37:19.568-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:37:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:37:49.774-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:37:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:38:20.084-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:38:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:38:50.353-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:38:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:39:20.655-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:39:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:39:51.180-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:39:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:40:21.435-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:40:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:40:51.652-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:40:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:41:21.928-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:41:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:41:52.277-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:41:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:42:22.562-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:42:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:42:52.953-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:42:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:43:23.246-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:43:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:43:53.515-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:43:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:44:23.935-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:44:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:44:54.220-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:44:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:45:24.390-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:45:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:45:54.674-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:45:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:46:24.831-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:46:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:46:54.969-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:46:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:47:25.249-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:47:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:47:55.514-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:47:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:48:25.778-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:48:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:48:56.067-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:48:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:49:26.341-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:49:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:49:56.613-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:49:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:50:26.942-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:50:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:50:57.204-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:50:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:51:27.346-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:51:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:51:57.633-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:51:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:52:28.021-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:52:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:52:58.308-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:52:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:53:28.459-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:53:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:53:58.720-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:53:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:54:29.200-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:54:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:54:59.509-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:54:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:55:29.887-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:55:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:56:00.155-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:55:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:56:30.441-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:56:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:57:00.711-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:57:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:57:31.118-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:57:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:58:01.582-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:58:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:58:32.018-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:58:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:59:02.316-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:59:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T02:59:32.648-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 02:59:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:00:02.916-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:00:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:00:33.305-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:00:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:01:03.608-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:01:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:01:33.965-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:01:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:02:04.254-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:02:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:02:34.531-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:02:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:03:04.761-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:03:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:03:35.072-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:03:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:04:05.429-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:04:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:04:35.670-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:04:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:05:05.964-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:05:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:05:36.104-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:05:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:06:06.378-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:06:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:06:36.673-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:06:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:07:06.949-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:07:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:07:37.113-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:07:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:08:07.397-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:08:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:08:37.670-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:08:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:09:07.933-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:09:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:09:38.220-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:09:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:10:08.568-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:10:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:10:38.723-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:10:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:11:08.885-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:11:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:11:39.156-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:11:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:12:09.450-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:12:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:12:39.741-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:12:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:13:09.970-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:13:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:13:40.269-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:13:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:14:10.533-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:14:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:14:40.810-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:14:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:15:11.082-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:15:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:15:41.361-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:15:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:16:11.579-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:16:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:16:41.918-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:16:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:17:12.268-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:17:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:17:42.482-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:17:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:18:12.759-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:18:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:18:43.060-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:18:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:19:13.318-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:19:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:19:43.643-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:19:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:20:13.910-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:20:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:20:44.191-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:20:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:21:14.454-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:21:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:21:44.702-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:21:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:22:14.989-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:22:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:22:45.181-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:22:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:23:15.530-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:23:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:23:45.832-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:23:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:24:16.060-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:24:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:24:46.328-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:24:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:25:16.690-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:25:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:25:46.968-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:25:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:26:17.224-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:26:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:26:47.532-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:26:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:27:17.843-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:27:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:27:48.060-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:27:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:28:18.236-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:28:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:28:48.517-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:28:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:29:19.070-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:29:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:29:49.278-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:29:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:30:19.594-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:30:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:30:49.917-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:30:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:31:20.300-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:31:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:31:50.604-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:31:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:32:20.847-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:32:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:32:51.068-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:32:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:33:21.370-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:33:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:33:51.603-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:33:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:34:21.861-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:34:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:34:52.093-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:34:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:35:22.370-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:35:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:35:52.532-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:35:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:36:22.793-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:36:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:36:53.070-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:36:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:37:23.295-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:37:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:37:53.517-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:37:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:38:23.767-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:38:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:38:53.948-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:38:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:39:24.270-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:39:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:39:54.546-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:39:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:40:24.917-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:40:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:40:55.084-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:40:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:41:25.389-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:41:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:41:55.662-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:41:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:42:25.816-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:42:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:42:56.036-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:42:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:43:26.335-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:43:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:43:56.566-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:43:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:44:26.799-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:44:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:44:57.153-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:44:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:45:27.350-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:45:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:45:57.478-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:45:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:46:27.842-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:46:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:46:58.117-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:46:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:47:28.262-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:47:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:47:58.526-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:47:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:48:28.919-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:48:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:48:59.203-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:48:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:49:29.505-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:49:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:49:59.946-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:49:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:50:30.211-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:50:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:51:00.496-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:51:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:51:30.784-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:51:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:52:01.055-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:52:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:52:31.393-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:52:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:53:01.522-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:53:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:53:31.830-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:53:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:54:02.032-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:54:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:54:32.317-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:54:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:55:02.591-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:55:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:55:32.785-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:55:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:56:03.203-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:56:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:56:33.484-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:56:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:57:03.715-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:57:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:57:33.855-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:57:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:58:04.195-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:58:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:58:34.473-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:58:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:59:04.797-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:59:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T03:59:35.093-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 03:59:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:00:05.457-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:00:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:00:35.748-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:00:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:01:06.043-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:01:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:01:36.320-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:01:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:02:06.618-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:02:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:02:36.962-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:02:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:03:07.179-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:03:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:03:37.440-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:03:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:04:07.861-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:04:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:04:38.140-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:04:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:05:08.453-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:05:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:05:38.728-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:05:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:06:08.872-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:06:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:06:39.146-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:06:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:07:09.364-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:07:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:07:39.632-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:07:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:08:09.885-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:08:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:08:40.160-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:08:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:09:10.432-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:09:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:09:40.724-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:09:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:10:11.008-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:10:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:10:41.293-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:10:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:11:11.504-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:11:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:11:41.903-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:11:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:12:12.248-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:12:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:12:42.487-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:12:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:13:12.772-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:13:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:13:43.050-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:13:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:14:13.335-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:14:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:14:43.664-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:14:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:15:14.095-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:15:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:15:44.383-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:15:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:16:14.816-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:16:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:16:45.011-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:16:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:17:15.296-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:17:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:17:45.503-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:17:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:18:15.786-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:18:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:18:46.035-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:18:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:19:16.279-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:19:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:19:46.573-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:19:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:20:16.757-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:20:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:20:46.965-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:20:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:21:17.253-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:21:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:21:47.516-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:21:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:22:17.830-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:22:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:22:48.126-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:22:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:23:18.363-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:23:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:23:48.602-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:23:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:24:18.898-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:24:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:24:49.229-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:24:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:25:19.511-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:25:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:25:49.911-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:25:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:26:20.126-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:26:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:26:50.404-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:26:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:27:20.683-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:27:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:27:51.020-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:27:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:28:21.472-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:28:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:28:51.794-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:28:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:29:22.072-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:29:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:29:52.246-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:29:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:30:22.453-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:30:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:30:52.714-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:30:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:31:22.921-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:31:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:31:53.242-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:31:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:32:23.643-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:32:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:32:54.029-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:32:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:33:24.319-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:33:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:33:54.609-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:33:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:34:24.809-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:34:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:34:55.090-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:34:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:35:25.334-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:35:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:35:55.613-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:35:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:36:25.758-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:36:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:36:56.015-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:36:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:37:26.353-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:37:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:37:56.672-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:37:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:38:26.971-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:38:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:38:57.230-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:38:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:39:27.503-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:39:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:39:57.774-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:39:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:40:28.057-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:40:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:40:58.339-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:40:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:41:28.627-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:41:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:41:58.952-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:41:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:42:29.227-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:42:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:42:59.502-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:42:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:43:29.784-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:43:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:44:00.068-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:43:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:44:30.389-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:44:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:45:00.536-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:45:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:45:30.780-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:45:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:46:01.061-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:46:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:46:31.359-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:46:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:47:01.614-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:47:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:47:31.916-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:47:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:48:02.192-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:48:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:48:32.537-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:48:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:49:02.817-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:49:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:49:33.085-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:49:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:50:03.415-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:50:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:50:33.792-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:50:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:51:04.012-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:51:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:51:34.175-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:51:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:52:04.330-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:52:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:52:34.600-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:52:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:53:04.878-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:53:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:53:35.214-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:53:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:54:05.500-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:54:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:54:35.751-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:54:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:55:06.026-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:55:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:55:36.403-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:55:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:56:06.683-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:56:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:56:36.963-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:56:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:57:07.236-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:57:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:57:37.497-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:57:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:58:07.651-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:58:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:58:37.829-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:58:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:59:08.024-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:59:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T04:59:38.281-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 04:59:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:00:08.524-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:00:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:00:38.797-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:00:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:01:09.003-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:01:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:01:39.401-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:01:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:02:09.665-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:02:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:02:39.953-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:02:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:03:10.188-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:03:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:03:40.487-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:03:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:04:10.782-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:04:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:04:41.058-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:04:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:05:11.342-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:05:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:05:41.647-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:05:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:06:12.014-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:06:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:06:42.176-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:06:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:07:12.561-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:07:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:07:42.832-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:07:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:08:12.973-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:08:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:08:43.168-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:08:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:09:13.299-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:09:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:09:43.632-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:09:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:10:13.982-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:10:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:10:44.343-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:10:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:11:14.630-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:11:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:11:44.976-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:11:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:12:15.279-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:12:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:12:45.624-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:12:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:13:15.910-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:13:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:13:46.142-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:13:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:14:16.455-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:14:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:14:46.623-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:14:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:15:16.915-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:15:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:15:47.264-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:15:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:16:17.480-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:16:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:16:47.772-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:16:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:17:18.077-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:17:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:17:48.315-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:17:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:18:18.482-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:18:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:18:48.813-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:18:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:19:19.088-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:19:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:19:49.367-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:19:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:20:19.653-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:20:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:20:49.938-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:20:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:21:20.238-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:21:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:21:50.536-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:21:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:22:20.812-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:22:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:22:51.036-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:22:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:23:21.332-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:23:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:23:51.558-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:23:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:24:21.768-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:24:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:24:52.146-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:24:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:25:22.400-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:25:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:25:52.649-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:25:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:26:22.936-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:26:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:26:53.261-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:26:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:27:23.551-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:27:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:27:53.794-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:27:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:28:23.973-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:28:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:28:54.414-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:28:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:29:24.682-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:29:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:29:55.151-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:29:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:30:25.424-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:30:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:30:55.749-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:30:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:31:25.892-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:31:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:31:56.167-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:31:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:32:26.451-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:32:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:32:56.784-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:32:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:33:27.051-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:33:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:33:57.331-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:33:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:34:27.630-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:34:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:34:57.859-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:34:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:35:28.152-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:35:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:35:58.354-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:35:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:36:28.645-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:36:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:36:58.813-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:36:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:37:29.136-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:37:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:37:59.403-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:37:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:38:29.572-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:38:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:38:59.783-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:38:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:39:29.977-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:39:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:40:00.264-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:39:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:40:30.428-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:40:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:41:00.696-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:41:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:41:30.977-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:41:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:42:01.127-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:42:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:42:31.351-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:42:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:43:01.653-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:43:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:43:32.048-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:43:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:44:02.465-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:44:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:44:32.759-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:44:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:45:03.053-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:45:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:45:33.357-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:45:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:46:03.632-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:46:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:46:33.889-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:46:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:47:04.280-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:47:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:47:34.551-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:47:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:48:04.785-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:48:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:48:35.064-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:48:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:49:05.348-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:49:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:49:35.631-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:49:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:50:06.025-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:50:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:50:36.185-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:50:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:51:06.455-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:51:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:51:36.777-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:51:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:52:07.012-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:52:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:52:37.259-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:52:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:53:07.528-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:53:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:53:37.726-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:53:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:54:08.004-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:54:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:54:38.298-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:54:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:55:08.596-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:55:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:55:38.887-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:55:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:56:09.117-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:56:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:56:39.398-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:56:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:57:09.748-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:57:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:57:39.918-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:57:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:58:10.115-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:58:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:58:40.324-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:58:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:59:10.678-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:59:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T05:59:40.952-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 05:59:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:00:11.247-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:00:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:00:41.515-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:00:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:01:11.708-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:01:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:01:42.115-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:01:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:02:12.419-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:02:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:02:42.649-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:02:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:03:12.813-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:03:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:03:43.060-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:03:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:04:13.480-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:04:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:04:43.758-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:04:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:05:14.055-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:05:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:05:44.252-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:05:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:06:14.413-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:06:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:06:44.686-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:06:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:07:14.958-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:07:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:07:45.279-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:07:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:08:15.557-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:08:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:08:45.752-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:08:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:09:16.101-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:09:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:09:46.387-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:09:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:10:16.583-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:10:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:10:46.919-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:10:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:11:17.192-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:11:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:11:47.497-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:11:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:12:17.830-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:12:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:12:48.027-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:12:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:13:18.308-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:13:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:13:48.446-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:13:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:14:18.684-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:14:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:14:48.960-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:14:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:15:19.247-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:15:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:15:49.581-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:15:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:16:19.856-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:16:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:16:50.120-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:16:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:17:20.392-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:17:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:17:50.528-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:17:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:18:20.792-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:18:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:18:51.110-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:18:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:19:21.373-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:19:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:19:51.684-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:19:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:20:21.982-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:20:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:20:52.145-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:20:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:21:22.511-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:21:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:21:52.790-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:21:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:22:23.014-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:22:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:22:53.232-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:22:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:23:23.501-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:23:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:23:53.772-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:23:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:24:24.061-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:24:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:24:54.391-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:24:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:25:24.584-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:25:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:25:54.883-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:25:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:26:25.169-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:26:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:26:55.428-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:26:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:27:25.633-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:27:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:27:55.933-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:27:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:28:26.223-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:28:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:28:56.476-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:28:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:29:26.755-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:29:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:29:56.961-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:29:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:30:27.145-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:30:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:30:57.474-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:30:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:31:27.621-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:31:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:31:57.896-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:31:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:32:28.231-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:32:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:32:58.649-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:32:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:33:28.808-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:33:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:33:59.080-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:33:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:34:29.276-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:34:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:34:59.630-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:34:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:35:30.114-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:35:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:36:00.392-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:36:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:36:30.715-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:36:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:37:00.975-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:37:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:37:31.273-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:37:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:38:01.449-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:38:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:38:31.711-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:38:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:39:01.971-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:39:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:39:32.258-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:39:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:40:02.554-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:40:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:40:32.815-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:40:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:41:03.142-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:41:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:41:33.425-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:41:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:42:03.612-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:42:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:42:33.835-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:42:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:43:04.120-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:43:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:43:34.427-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:43:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:44:04.716-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:44:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:44:34.992-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:44:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:45:05.132-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:45:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:45:35.290-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:45:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:46:05.664-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:46:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:46:35.883-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:46:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:47:06.148-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:47:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:47:36.482-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:47:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:48:06.768-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:48:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:48:37.039-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:48:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:49:07.418-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:49:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:49:37.662-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:49:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:50:08.020-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:50:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:50:38.299-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:50:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:51:08.587-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:51:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:51:38.846-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:51:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:52:09.009-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:52:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:52:39.150-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:52:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:53:09.403-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:53:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:53:39.597-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:53:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:54:09.879-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:54:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:54:40.169-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:54:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:55:10.518-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:55:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:55:40.804-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:55:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:56:11.063-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:56:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:56:41.339-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:56:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:57:11.617-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:57:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:57:41.915-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:57:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:58:12.201-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:58:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:58:42.465-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:58:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:59:12.957-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:59:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T06:59:43.166-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 06:59:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:00:13.458-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:00:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:00:43.743-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:00:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:01:14.014-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:01:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:01:44.256-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:01:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:02:14.447-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:02:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:02:44.748-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:02:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:03:14.919-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:03:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:03:45.176-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:03:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:04:15.333-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:04:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:04:45.509-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:04:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:05:15.926-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:05:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:05:46.113-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:05:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:06:16.543-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:06:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:06:46.787-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:06:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:07:17.078-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:07:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:07:47.323-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:07:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:08:17.611-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:08:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:08:47.907-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:08:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:09:18.143-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:09:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:09:48.421-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:09:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:10:18.698-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:10:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:10:49.096-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:10:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:11:19.287-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:11:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:11:49.588-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:11:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:12:19.872-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:12:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:12:50.325-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:12:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:13:20.687-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:13:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:13:50.854-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:13:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:14:21.110-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:14:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:14:51.346-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:14:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:15:21.587-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:15:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:15:51.959-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:15:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:16:22.258-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:16:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:16:52.412-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:16:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:17:22.559-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:17:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:17:52.805-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:17:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:18:23.077-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:18:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:18:53.481-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:18:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:19:23.738-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:19:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:19:53.922-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:19:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:20:24.062-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:20:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:20:54.343-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:20:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:21:24.582-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:21:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:21:54.867-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:21:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:22:25.147-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:22:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:22:55.383-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:22:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:23:25.697-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:23:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:23:55.986-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:23:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:24:26.267-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:24:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:24:56.540-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:24:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:25:26.803-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:25:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:25:57.078-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:25:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:26:27.468-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:26:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:26:57.763-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:26:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:27:28.127-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:27:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:27:58.368-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:27:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:28:28.540-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:28:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:28:58.930-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:28:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:29:29.199-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:29:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:29:59.486-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:29:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:30:29.767-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:30:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:31:00.118-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:30:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:31:30.357-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:31:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:32:00.666-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:32:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:32:31.104-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:32:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:33:01.371-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:33:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:33:31.648-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:33:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:34:01.827-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:34:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:34:32.204-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:34:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:35:02.466-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:35:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:35:32.608-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:35:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:36:02.889-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:36:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:36:33.201-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:36:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:37:03.524-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:37:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:37:33.803-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:37:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:38:03.939-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:38:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:38:34.190-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:38:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:39:04.480-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:39:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:39:34.729-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:39:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:40:05.199-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:40:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:40:35.474-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:40:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:41:05.668-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:41:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:41:35.838-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:41:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:42:06.094-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:42:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:42:36.387-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:42:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:43:06.674-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:43:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:43:36.862-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:43:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:44:07.181-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:44:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:44:37.470-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:44:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:45:07.764-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:45:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:45:38.031-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:45:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:46:08.308-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:46:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:46:38.653-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:46:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:47:08.955-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:47:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:47:39.298-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:47:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:48:09.584-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:48:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:48:39.901-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:48:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:49:10.297-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:49:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:49:40.537-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:49:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:50:10.803-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:50:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:50:40.991-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:50:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:51:11.313-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:51:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:51:41.583-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:51:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:52:11.845-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:52:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:52:42.114-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:52:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:53:12.414-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:53:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:53:42.581-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:53:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:54:12.714-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:54:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:54:42.939-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:54:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:55:13.224-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:55:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:55:43.492-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:55:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:56:13.751-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:56:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:56:44.075-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:56:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:57:14.335-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:57:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:57:44.512-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:57:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:58:14.666-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:58:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:58:44.963-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:58:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:59:15.252-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:59:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T07:59:45.529-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 07:59:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:00:15.828-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:00:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:00:46.096-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:00:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:01:16.294-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:01:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:01:46.501-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:01:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:02:16.789-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:02:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:02:47.061-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:02:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:03:17.341-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:03:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:03:47.524-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:03:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:04:17.691-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:04:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:04:47.850-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:04:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:05:18.109-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:05:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:05:48.491-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:05:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:06:18.778-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:06:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:06:49.054-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:06:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:07:19.405-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:07:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:07:49.664-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:07:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:08:20.022-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:08:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:08:50.317-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:08:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:09:20.475-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:09:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:09:50.618-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:09:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:10:20.915-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:10:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:10:51.279-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:10:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:11:21.628-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:11:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:11:51.912-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:11:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:12:22.068-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:12:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:12:52.378-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:12:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:13:22.662-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:13:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:13:52.994-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:13:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:14:23.278-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:14:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:14:53.525-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:14:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:15:23.682-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:15:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:15:54.027-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:15:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:16:24.296-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:16:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:16:54.558-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:16:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:17:24.707-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:17:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:17:54.913-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:17:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:18:25.071-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:18:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:18:55.390-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:18:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:19:25.717-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:19:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:19:55.974-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:19:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:20:26.210-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:20:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:20:56.475-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:20:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:21:26.739-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:21:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:21:57.069-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:21:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:22:27.337-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:22:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:22:57.537-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:22:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:23:27.918-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:23:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:23:58.058-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:23:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:24:28.238-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:24:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:24:58.397-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:24:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:25:28.678-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:25:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:25:58.897-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:25:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:26:29.043-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:26:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:26:59.298-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:26:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:27:29.561-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:27:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:27:59.844-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:27:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:28:30.124-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:28:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:29:00.356-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:29:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:29:30.624-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:29:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:30:00.893-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:30:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:30:31.170-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:30:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:31:01.441-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:31:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:31:31.760-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:31:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:32:02.122-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:32:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:32:32.256-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:32:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:33:02.871-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:33:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:33:33.160-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:33:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:34:03.350-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:34:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:34:33.486-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:34:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:35:03.775-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:35:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:35:34.167-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:35:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:36:04.467-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:36:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:36:34.634-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:36:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:37:04.821-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:37:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:37:35.096-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:37:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:38:05.347-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:38:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:38:35.642-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:38:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:39:05.863-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:39:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:39:36.103-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:39:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:40:06.431-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:40:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:40:36.857-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:40:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:41:07.072-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:41:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:41:37.346-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:41:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:42:07.669-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:42:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:42:37.895-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:42:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:43:08.189-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:43:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:43:38.347-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:43:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:44:08.616-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:44:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:44:38.891-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:44:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:45:09.179-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:45:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:45:39.386-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:45:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:46:09.657-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:46:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:46:39.928-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:46:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:47:10.216-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:47:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:47:40.446-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:47:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:48:10.753-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:48:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:48:40.900-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:48:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:49:11.206-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:49:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:49:41.503-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:49:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:50:11.894-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:50:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:50:42.149-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:50:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:51:12.432-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:51:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:51:42.713-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:51:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:52:13.064-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:52:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:52:43.340-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:52:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:53:13.512-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:53:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:53:43.785-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:53:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:54:13.925-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:54:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:54:44.156-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:54:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:55:14.432-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:55:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:55:44.718-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:55:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:56:14.927-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:56:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:56:45.097-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:56:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:57:15.335-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:57:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:57:45.656-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:57:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:58:15.792-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:58:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:58:46.077-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:58:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:59:16.611-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:59:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T08:59:46.905-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 08:59:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:00:17.110-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:00:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:00:47.405-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:00:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:01:17.703-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:01:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:01:48.089-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:01:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:02:18.463-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:02:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:02:48.798-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:02:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:03:19.059-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:03:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:03:49.340-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:03:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:04:19.672-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:04:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:04:49.928-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:04:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:05:20.248-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:05:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:05:50.481-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:05:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:06:20.908-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:06:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:06:51.325-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:06:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:07:21.679-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:07:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:07:51.967-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:07:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:08:22.237-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:08:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:08:52.588-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:08:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:09:22.879-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:09:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:09:53.205-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:09:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:10:23.577-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:10:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:10:53.958-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:10:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:11:24.287-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:11:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:11:54.539-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:11:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:12:24.747-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:12:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:12:55.006-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:12:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:13:25.290-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:13:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:13:55.458-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:13:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:14:25.737-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:14:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:14:55.945-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:14:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:15:26.231-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:15:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:15:56.511-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:15:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:16:26.862-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:16:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:16:57.096-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:16:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:17:27.387-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:17:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:17:57.664-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:17:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:18:27.821-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:18:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:18:58.113-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:18:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:19:28.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:19:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:19:58.618-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:19:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:20:28.822-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:20:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:20:59.108-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:20:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:21:29.298-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:21:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:21:59.648-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:21:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:22:29.929-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:22:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:23:00.246-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:22:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:23:30.556-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:23:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:24:00.831-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:24:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:24:31.080-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:24:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:25:01.306-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:25:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:25:31.689-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:25:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:26:01.989-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:26:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:26:32.195-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:26:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:27:02.503-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:27:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:27:32.796-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:27:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:28:02.968-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:28:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:28:33.208-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:28:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:29:03.517-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:29:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:29:33.865-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:29:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:30:04.088-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:30:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:30:34.420-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:30:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:31:04.804-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:31:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:31:35.193-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:31:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:32:05.337-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:32:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:32:35.539-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:32:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:33:05.879-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:33:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:33:36.087-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:33:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:34:06.340-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:34:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:34:36.658-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:34:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:35:06.934-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:35:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:35:37.113-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:35:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:36:07.388-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:36:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:36:37.778-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:36:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:37:08.140-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:37:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:37:38.462-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:37:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:38:08.719-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:38:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:38:38.995-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:38:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:39:09.284-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:39:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:39:39.583-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:39:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:40:09.728-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:40:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:40:39.986-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:40:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:41:10.147-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:41:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:41:40.452-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:41:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:42:10.688-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:42:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:42:40.939-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:42:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:43:11.144-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:43:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:43:41.412-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:43:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:44:11.707-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:44:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:44:42.086-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:44:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:45:12.373-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:45:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:45:42.782-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:45:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:46:13.061-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:46:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:46:43.363-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:46:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:47:13.683-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:47:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:47:43.993-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:47:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:48:14.322-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:48:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:48:44.651-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:48:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:49:14.956-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:49:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:49:45.146-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:49:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:50:15.445-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:50:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:50:45.723-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:50:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:51:16.181-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:51:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:51:46.436-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:51:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:52:16.826-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:52:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:52:47.145-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:52:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:53:17.428-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:53:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:53:47.685-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:53:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:54:17.943-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:54:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:54:48.218-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:54:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:55:18.448-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:55:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:55:48.880-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:55:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:56:19.266-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:56:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:56:49.571-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:56:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:57:19.862-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:57:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:57:50.151-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:57:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:58:20.423-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:58:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:58:50.702-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:58:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:59:20.878-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:59:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T09:59:51.179-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 09:59:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:00:21.318-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:00:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:00:51.690-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:00:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:01:21.969-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:01:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:01:52.203-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:01:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:02:22.483-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:02:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:02:52.857-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:02:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:03:23.162-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:03:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:03:53.390-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:03:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:04:23.680-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:04:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:04:53.966-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:04:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:05:24.112-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:05:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:05:54.445-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:05:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:06:24.803-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:06:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:06:55.101-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:06:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:07:25.376-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:07:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:07:55.717-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:07:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:08:26.043-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:08:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:08:56.350-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:08:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:09:26.662-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:09:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:09:56.880-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:09:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:10:27.198-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:10:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:10:57.452-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:10:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:11:27.647-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:11:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:11:57.886-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:11:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:12:28.185-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:12:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:12:58.415-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:12:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:13:28.711-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:13:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:13:58.953-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:13:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:14:29.141-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:14:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:14:59.472-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:14:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:15:29.642-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:15:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:15:59.867-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:15:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:16:30.136-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:16:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:17:00.398-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:17:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:17:30.676-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:17:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:18:00.922-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:18:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:18:31.190-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:18:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:19:01.494-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:19:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:19:31.749-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:19:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:20:02.034-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:20:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:20:32.187-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:20:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:21:02.444-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:21:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:21:32.763-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:21:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:22:03.040-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:22:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:22:33.190-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:22:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:23:03.427-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:23:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:23:33.681-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:23:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:24:04.012-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:24:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:24:34.299-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:24:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:25:04.579-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:25:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:25:34.934-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:25:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:26:05.244-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:26:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:26:35.555-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:26:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:27:05.847-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:27:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:27:36.263-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:27:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:28:06.463-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:28:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:28:36.876-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:28:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:29:07.178-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:29:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:29:37.438-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:29:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:30:07.758-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:30:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:30:38.027-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:30:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:31:08.537-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:31:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:31:38.692-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:31:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:32:09.108-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:32:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:32:39.393-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:32:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:33:09.715-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:33:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:33:39.987-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:33:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:34:10.301-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:34:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:34:40.635-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:34:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:35:10.925-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:35:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:35:41.118-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:35:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:36:11.410-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:36:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:36:41.775-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:36:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:37:12.082-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:37:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:37:42.383-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:37:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:38:12.724-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:38:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:38:42.905-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:38:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:39:13.210-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:39:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:39:43.538-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:39:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:40:13.802-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:40:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:40:44.046-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:40:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:41:14.354-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:41:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:41:44.678-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:41:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:42:14.947-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:42:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:42:45.218-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:42:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:43:15.557-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:43:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:43:46.026-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:43:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:44:16.187-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:44:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:44:46.488-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:44:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:45:16.725-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:45:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:45:46.876-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:45:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:46:17.246-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:46:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:46:47.551-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:46:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:47:17.703-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:47:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:47:47.956-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:47:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:48:18.252-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:48:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:48:48.495-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:48:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:49:18.749-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:49:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:49:48.956-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:49:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:50:19.192-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:50:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:50:49.521-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:50:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:51:19.821-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:51:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:51:50.140-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:51:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:52:20.429-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:52:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:52:50.817-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:52:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:53:21.145-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:53:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:53:51.475-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:53:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:54:21.758-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:54:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:54:51.941-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:54:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:55:22.218-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:55:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:55:52.480-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:55:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:56:22.763-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:56:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:56:53.052-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:56:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:57:23.374-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:57:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:57:53.570-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:57:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:58:23.862-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:58:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:58:54.151-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:58:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:59:24.416-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:59:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T10:59:54.694-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 10:59:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:00:24.951-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:00:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:00:55.219-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:00:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:01:25.497-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:01:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:01:55.720-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:01:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:02:26.130-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:02:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:02:56.265-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:02:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:03:26.696-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:03:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:03:56.872-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:03:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:04:27.003-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:04:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:04:57.331-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:04:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:05:27.632-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:05:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:05:57.827-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:05:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:06:28.102-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:06:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:06:58.322-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:06:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:07:28.700-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:07:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:07:58.972-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:07:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:08:29.352-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:08:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:08:59.681-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:08:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:09:30.026-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:09:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:10:00.249-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:10:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:10:30.683-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:10:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:11:00.979-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:11:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:11:31.252-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:11:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:12:01.433-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:12:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:12:31.599-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:12:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:13:01.799-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:13:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:13:32.054-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:13:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:14:02.447-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:14:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:14:32.825-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:14:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:15:03.065-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:15:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:15:33.354-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:15:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:16:03.620-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:16:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:16:33.893-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:16:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:17:04.314-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:17:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:17:34.512-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:17:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:18:04.794-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:18:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:18:35.059-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:18:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:19:05.237-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:19:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:19:35.570-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:19:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:20:05.941-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:20:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:20:36.201-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:20:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:21:06.547-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:21:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:21:36.749-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:21:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:22:07.096-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:22:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:22:37.385-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:22:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:23:07.850-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:23:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:23:38.144-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:23:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:24:08.485-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:24:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:24:38.679-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:24:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:25:08.973-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:25:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:25:39.239-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:25:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:26:09.517-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:26:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:26:39.793-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:26:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:27:09.958-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:27:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:27:40.224-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:27:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:28:10.517-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:28:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:28:40.789-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:28:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:29:10.979-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:29:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:29:41.272-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:29:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:30:11.424-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:30:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:30:41.762-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:30:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:31:12.185-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:31:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:31:42.524-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:31:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:32:12.789-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:32:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:32:43.102-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:32:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:33:13.505-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:33:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:33:43.789-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:33:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:34:14.107-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:34:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:34:44.420-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:34:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:35:14.692-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:35:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:35:44.990-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:35:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:36:15.295-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:36:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:36:45.432-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:36:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:37:15.752-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:37:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:37:46.042-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:37:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:38:16.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:38:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:38:46.777-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:38:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:39:16.998-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:39:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:39:47.387-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:39:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:40:17.573-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:40:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:40:47.854-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:40:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:41:18.245-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:41:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:41:48.504-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:41:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:42:18.703-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:42:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:42:49.002-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:42:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:43:19.311-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:43:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:43:49.572-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:43:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:44:19.954-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:44:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:44:50.238-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:44:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:45:20.533-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:45:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:45:50.791-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:45:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:46:21.213-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:46:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:46:51.622-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:46:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:47:21.914-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:47:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:47:52.116-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:47:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:48:22.503-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:48:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:48:52.770-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:48:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:49:22.934-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:49:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:49:53.204-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:49:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:50:23.403-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:50:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:50:53.558-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:50:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:51:23.884-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:51:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:51:54.155-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:51:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:52:24.301-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:52:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:52:54.633-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:52:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:53:24.897-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:53:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:53:55.052-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:53:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:54:25.309-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:54:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:54:55.579-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:54:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:55:25.840-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:55:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:55:56.066-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:55:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:56:26.227-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:56:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:56:56.518-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:56:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:57:26.760-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:57:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:57:56.916-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:57:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:58:27.205-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:58:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:58:57.497-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:58:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:59:27.835-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:59:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T11:59:58.093-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 11:59:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:00:28.477-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:00:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:00:58.802-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:00:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:01:28.996-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:01:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:01:59.210-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:01:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:02:29.485-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:02:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:02:59.654-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:02:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:03:29.949-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:03:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:04:00.236-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:03:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:04:30.431-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:04:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:05:00.608-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:05:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:05:30.929-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:05:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:06:01.314-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:06:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:06:31.632-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:06:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:07:02.005-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:07:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:07:32.322-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:07:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:08:02.574-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:08:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:08:32.980-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:08:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:09:03.244-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:09:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:09:33.421-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:09:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:10:03.778-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:10:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:10:34.096-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:10:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:11:04.240-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:11:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:11:34.387-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:11:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:12:04.731-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:12:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:12:35.065-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:12:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:13:05.341-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:13:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:13:35.621-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:13:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:14:05.916-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:14:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:14:36.375-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:14:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:15:06.587-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:15:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:15:36.731-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:15:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:16:06.931-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:16:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:16:37.089-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:16:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:17:07.425-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:17:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:17:37.707-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:17:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:18:07.991-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:18:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:18:38.258-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:18:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:19:08.517-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:19:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:19:38.843-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:19:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:20:08.982-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:20:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:20:39.413-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:20:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:21:09.619-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:21:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:21:39.909-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:21:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:22:10.180-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:22:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:22:40.462-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:22:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:23:10.792-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:23:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:23:40.974-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:23:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:24:11.308-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:24:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:24:41.604-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:24:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:25:11.806-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:25:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:25:42.080-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:25:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:26:12.375-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:26:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:26:42.543-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:26:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:27:12.834-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:27:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:27:43.178-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:27:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:28:13.505-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:28:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:28:43.804-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:28:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:29:14.189-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:29:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:29:44.388-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:29:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:30:14.687-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:30:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:30:44.970-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:30:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:31:15.381-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:31:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:31:45.638-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:31:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:32:15.957-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:32:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:32:46.181-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:32:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:33:16.557-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:33:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:33:46.866-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:33:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:34:17.147-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:34:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:34:47.400-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:34:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:35:17.672-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:35:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:35:47.964-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:35:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:36:18.148-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:36:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:36:48.343-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:36:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:37:18.619-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:37:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:37:48.933-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:37:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:38:19.220-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:38:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:38:49.571-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:38:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:39:19.918-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:39:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:39:50.267-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:39:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:40:20.557-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:40:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:40:50.739-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:40:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:41:20.918-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:41:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:41:51.201-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:41:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:42:21.615-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:42:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:42:51.895-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:42:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:43:22.163-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:43:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:43:52.452-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:43:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:44:22.733-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:44:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:44:52.865-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:44:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:45:23.143-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:45:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:45:53.390-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:45:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:46:23.898-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:46:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:46:54.189-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:46:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:47:24.335-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:47:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:47:54.710-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:47:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:48:25.081-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:48:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:48:55.445-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:48:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:49:25.741-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:49:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:49:56.008-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:49:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:50:26.299-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:50:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:50:56.583-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:50:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:51:26.743-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:51:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:51:56.888-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:51:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:52:27.187-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:52:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:52:57.530-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:52:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:53:27.841-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:53:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:53:58.104-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:53:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:54:28.273-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:54:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:54:58.649-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:54:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:55:29.109-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:55:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:55:59.392-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:55:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:56:29.654-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:56:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:56:59.825-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:56:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:57:30.023-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:57:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:58:00.313-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:58:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:58:30.787-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:58:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:59:01.095-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:59:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T12:59:31.433-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 12:59:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:00:01.725-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:00:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:00:32.001-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:00:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:01:02.155-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:01:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:01:32.338-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:01:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:02:02.626-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:02:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:02:32.906-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:02:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:03:03.070-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:03:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:03:33.371-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:03:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:04:03.684-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:04:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:04:34.036-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:04:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:05:04.260-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:05:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:05:34.544-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:05:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:06:04.801-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:06:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:06:35.097-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:06:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:07:05.387-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:07:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:07:35.696-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:07:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:08:05.854-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:08:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:08:36.133-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:08:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:09:06.456-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:09:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:09:36.757-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:09:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:10:07.023-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:10:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:10:37.256-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:10:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:11:07.465-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:11:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:11:37.772-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:11:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:12:08.034-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:12:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:12:38.230-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:12:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:13:08.771-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:13:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:13:38.918-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:13:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:14:09.228-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:14:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:14:39.512-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:14:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:15:09.835-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:15:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:15:40.288-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:15:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:16:10.589-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:16:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:16:40.873-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:16:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:17:11.138-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:17:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:17:41.373-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:17:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:18:11.812-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:18:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:18:42.111-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:18:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:19:12.348-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:19:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:19:42.632-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:19:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:20:12.901-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:20:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:20:43.144-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:20:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:21:13.442-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:21:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:21:43.715-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:21:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:22:14.020-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:22:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:22:44.238-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:22:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:23:14.440-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:23:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:23:44.720-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:23:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:24:15.038-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:24:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:24:45.355-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:24:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:25:15.538-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:25:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:25:45.730-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:25:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:26:16.153-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:26:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:26:46.318-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:26:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:27:16.638-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:27:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:27:46.905-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:27:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:28:17.181-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:28:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:28:47.449-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:28:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:29:17.735-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:29:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:29:48.124-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:29:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:30:18.419-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:30:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:30:48.654-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:30:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:31:18.853-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:31:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:31:49.134-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:31:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:32:19.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:32:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:32:49.665-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:32:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:33:19.846-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:33:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:33:50.148-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:33:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:34:20.443-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:34:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:34:50.672-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:34:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:35:20.968-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:35:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:35:51.209-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:35:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:36:21.590-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:36:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:36:51.783-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:36:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:37:22.046-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:37:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:37:52.341-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:37:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:38:22.617-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:38:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:38:52.820-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:38:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:39:22.966-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:39:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:39:53.153-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:39:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:40:23.371-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:40:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:40:53.676-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:40:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:41:23.966-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:41:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:41:54.161-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:41:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:42:24.492-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:42:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:42:54.759-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:42:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:43:24.979-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:43:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:43:55.323-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:43:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:44:25.601-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:44:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:44:55.892-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:44:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:45:26.299-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:45:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:45:56.672-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:45:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:46:26.867-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:46:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:46:57.143-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:46:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:47:27.353-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:47:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:47:57.543-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:47:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:48:27.833-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:48:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:48:58.285-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:48:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:49:28.547-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:49:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:49:58.813-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:49:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:50:29.055-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:50:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:50:59.213-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:50:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:51:29.487-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:51:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:51:59.828-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:51:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:52:30.033-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:52:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:53:00.428-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:53:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:53:30.694-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:53:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:54:01.013-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:54:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:54:31.153-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:54:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:55:01.433-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:55:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:55:31.769-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:55:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:56:02.058-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:56:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:56:32.255-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:56:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:57:02.548-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:57:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:57:32.711-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:57:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:58:02.938-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:58:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:58:33.215-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:58:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:59:03.483-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:59:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T13:59:33.785-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 13:59:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:00:03.971-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:00:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:00:34.464-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:00:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:01:04.728-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:01:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:01:35.146-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:01:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:02:05.290-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:02:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:02:35.635-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:02:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:03:05.915-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:03:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:03:36.196-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:03:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:04:06.374-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:04:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:04:36.660-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:04:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:05:06.931-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:05:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:05:37.259-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:05:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:06:07.554-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:06:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:06:37.887-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:06:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:07:08.052-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:07:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:07:38.279-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:07:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:08:08.559-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:08:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:08:38.907-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:08:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:09:09.172-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:09:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:09:39.388-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:09:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:10:09.646-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:10:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:10:39.939-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:10:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:11:10.073-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:11:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:11:40.335-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:11:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:12:10.663-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:12:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:12:41.009-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:12:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:13:11.276-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:13:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:13:41.448-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:13:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:14:11.719-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:14:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:14:41.994-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:14:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:15:12.246-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:15:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:15:42.522-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:15:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:16:12.807-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:16:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:16:42.977-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:16:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:17:13.246-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:17:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:17:43.460-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:17:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:18:13.627-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:18:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:18:43.927-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:18:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:19:14.217-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:19:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:19:44.373-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:19:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:20:14.673-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:20:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:20:44.941-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:20:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:21:15.220-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:21:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:21:45.470-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:21:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:22:15.770-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:22:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:22:46.059-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:22:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:23:16.386-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:23:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:23:46.600-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:23:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:24:16.867-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:24:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:24:47.152-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:24:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:25:17.364-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:25:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:25:47.724-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:25:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:26:18.049-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:26:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:26:48.199-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:26:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:27:18.331-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:27:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:27:48.549-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:27:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:28:19.007-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:28:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:28:49.300-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:28:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:29:19.597-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:29:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:29:49.868-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:29:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:30:20.180-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:30:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:30:50.455-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:30:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:31:20.815-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:31:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:31:51.076-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:31:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:32:21.239-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:32:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:32:51.543-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:32:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:33:21.799-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:33:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:33:52.133-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:33:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:34:22.431-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:34:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:34:52.719-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:34:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:35:23.014-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:35:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:35:53.326-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:35:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:36:23.471-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:36:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:36:53.764-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:36:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:37:24.068-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:37:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:37:54.353-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:37:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:38:24.656-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:38:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:38:54.881-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:38:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:39:25.203-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:39:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:39:55.462-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:39:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:40:25.598-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:40:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:40:55.878-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:40:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:41:26.212-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:41:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:41:56.514-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:41:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:42:26.765-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:42:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:42:56.911-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:42:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:43:27.253-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:43:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:43:57.533-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:43:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:44:27.825-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:44:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:44:58.098-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:44:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:45:28.254-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:45:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:45:58.443-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:45:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:46:28.766-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:46:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:46:59.205-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:46:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:47:29.561-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:47:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:47:59.836-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:47:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:48:30.101-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:48:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:49:00.405-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:49:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:49:30.584-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:49:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:50:00.933-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:50:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:50:31.232-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:50:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:51:01.406-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:51:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:51:31.736-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:51:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:52:01.993-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:52:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:52:32.262-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:52:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:53:02.403-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:53:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:53:32.687-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:53:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:54:02.954-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:54:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:54:33.283-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:54:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:55:03.573-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:55:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:55:33.884-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:55:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:56:04.139-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:56:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:56:34.496-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:56:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:57:04.810-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:57:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:57:35.017-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:57:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:58:05.302-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:58:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:58:35.580-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:58:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:59:05.934-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:59:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T14:59:36.075-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 14:59:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:00:06.356-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:00:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:00:36.650-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:00:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:01:06.919-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:01:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:01:37.184-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:01:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:02:07.551-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:02:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:02:37.749-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:02:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:03:08.123-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:03:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:03:38.512-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:03:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:04:08.684-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:04:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:04:38.956-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:04:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:05:09.383-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:05:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:05:39.631-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:05:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:06:09.906-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:06:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:06:40.171-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:06:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:07:10.453-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:07:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:07:40.700-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:07:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:08:10.952-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:08:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:08:41.292-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:08:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:09:11.660-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:09:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:09:41.799-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:09:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:10:12.073-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:10:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:10:42.358-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:10:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:11:12.675-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:11:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:11:42.836-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:11:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:12:13.040-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:12:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:12:43.176-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:12:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:13:13.492-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:13:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:13:44.014-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:13:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:14:14.493-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:14:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:14:44.837-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:14:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:15:15.110-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:15:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:15:45.448-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:15:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:16:15.705-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:16:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:16:45.963-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:16:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:17:16.143-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:17:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:17:46.442-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:17:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:18:16.770-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:18:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:18:47.035-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:18:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:19:17.449-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:19:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:19:47.783-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:19:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:20:18.047-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:20:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:20:48.206-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:20:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:21:18.474-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:21:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:21:48.738-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:21:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:22:18.917-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:22:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:22:49.206-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:22:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:23:19.464-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:23:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:23:49.764-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:23:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:24:20.061-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:24:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:24:50.220-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:24:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:25:20.489-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:25:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:25:50.769-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:25:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:26:21.033-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:26:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:26:51.233-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:26:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:27:21.504-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:27:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:27:51.945-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:27:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:28:22.355-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:28:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:28:52.627-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:28:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:29:23.057-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:29:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:29:53.397-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:29:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:30:23.664-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:30:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:30:53.946-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:30:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:31:24.179-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:31:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:31:54.478-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:31:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:32:24.624-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:32:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:32:54.906-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:32:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:33:25.179-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:33:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:33:55.487-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:33:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:34:25.770-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:34:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:34:56.107-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:34:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:35:26.270-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:35:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:35:56.545-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:35:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:36:26.907-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:36:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:36:57.213-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:36:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:37:27.389-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:37:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:37:57.708-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:37:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:38:27.866-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:38:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:38:58.034-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:38:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:39:28.321-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:39:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:39:58.602-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:39:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:40:28.895-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:40:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:40:59.052-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:40:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:41:29.339-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:41:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:41:59.610-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:41:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:42:29.958-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:42:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:43:00.267-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:42:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:43:30.548-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:43:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:44:00.753-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:44:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:44:30.925-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:44:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:45:01.218-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:45:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:45:31.493-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:45:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:46:01.789-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:46:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:46:32.072-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:46:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:47:02.340-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:47:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:47:32.502-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:47:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:48:02.814-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:48:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:48:33.153-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:48:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:49:03.430-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:49:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:49:33.696-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:49:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:50:03.972-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:50:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:50:34.250-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:50:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:51:04.429-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:51:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:51:34.723-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:51:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:52:05.028-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:52:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:52:35.355-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:52:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:53:05.638-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:53:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:53:35.914-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:53:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:54:06.266-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:54:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:54:36.464-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:54:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:55:06.674-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:55:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:55:37.039-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:55:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:56:07.361-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:56:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:56:37.537-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:56:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:57:07.815-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:57:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:57:38.084-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:57:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:58:08.535-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:58:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:58:38.722-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:58:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:59:09.131-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:59:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T15:59:39.308-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 15:59:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:00:09.553-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:00:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:00:39.838-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:00:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:01:10.255-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:01:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:01:40.523-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:01:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:02:10.806-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:02:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:02:41.036-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:02:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:03:11.360-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:03:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:03:41.643-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:03:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:04:11.957-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:04:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:04:42.106-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:04:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:05:12.391-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:05:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:05:42.671-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:05:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:06:12.945-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:06:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:06:43.237-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:06:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:07:13.615-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:07:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:07:43.976-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:07:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:08:14.351-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:08:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:08:44.508-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:08:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:09:14.794-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:09:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:09:45.128-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:09:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:10:15.334-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:10:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:10:45.511-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:10:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:11:15.921-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:11:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:11:46.428-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:11:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:12:16.698-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:12:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:12:46.950-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:12:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:13:17.266-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:13:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:13:47.602-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:13:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:14:17.889-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:14:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:14:48.180-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:14:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:15:18.491-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:15:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:15:48.774-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:15:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:16:19.055-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:16:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:16:49.204-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:16:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:17:19.495-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:17:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:17:49.795-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:17:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:18:20.099-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:18:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:18:50.425-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:18:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:19:20.711-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:19:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:19:50.985-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:19:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:20:21.305-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:20:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:20:51.629-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:20:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:21:21.896-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:21:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:21:52.287-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:21:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:22:22.442-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:22:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:22:52.728-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:22:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:23:22.950-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:23:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:23:53.206-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:23:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:24:23.483-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:24:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:24:53.741-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:24:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:25:24.124-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:25:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:25:54.390-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:25:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:26:24.708-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:26:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:26:54.961-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:26:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:27:25.208-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:27:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:27:55.489-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:27:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:28:25.715-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:28:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:28:55.971-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:28:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:29:26.122-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:29:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:29:56.388-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:29:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:30:26.670-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:30:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:30:56.938-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:30:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:31:27.227-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:31:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:31:57.551-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:31:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:32:27.853-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:32:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:32:58.137-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:32:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:33:28.427-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:33:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:33:58.806-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:33:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:34:28.959-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:34:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:34:59.105-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:34:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:35:29.368-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:35:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:35:59.647-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:35:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:36:30.022-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:36:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:37:00.393-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:37:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:37:30.669-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:37:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:38:00.960-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:38:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:38:31.304-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:38:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:39:01.575-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:39:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:39:31.884-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:39:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:40:02.186-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:40:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:40:32.416-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:40:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:41:02.699-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:41:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:41:32.983-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:41:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:42:03.258-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:42:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:42:33.535-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:42:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:43:03.800-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:43:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:43:34.078-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:43:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:44:04.373-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:44:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:44:34.555-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:44:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:45:04.842-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:45:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:45:35.062-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:45:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:46:05.406-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:46:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:46:35.584-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:46:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:47:05.887-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:47:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:47:36.165-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:47:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:48:06.426-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:48:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:48:36.624-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:48:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:49:06.791-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:49:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:49:37.075-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:49:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:50:07.360-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:50:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:50:37.660-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:50:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:51:07.809-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:51:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:51:38.033-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:51:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:52:08.295-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:52:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:52:38.571-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:52:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:53:08.911-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:53:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:53:39.096-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:53:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:54:09.429-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:54:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:54:39.690-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:54:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:55:09.878-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:55:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:55:40.163-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:55:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:56:10.446-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:56:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:56:40.724-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:56:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:57:10.987-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:57:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:57:41.301-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:57:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:58:11.595-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:58:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:58:41.871-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:58:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:59:12.022-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:59:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T16:59:42.339-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 16:59:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:00:12.468-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:00:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:00:42.627-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:00:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:01:12.856-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:01:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:01:43.126-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:01:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:02:13.417-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:02:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:02:43.786-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:02:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:03:14.068-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:03:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:03:44.354-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:03:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:04:14.642-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:04:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:04:45.033-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:04:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:05:15.320-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:05:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:05:45.491-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:05:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:06:15.878-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:06:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:06:46.258-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:06:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:07:16.554-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:07:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:07:46.770-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:07:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:08:16.970-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:08:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:08:47.255-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:08:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:09:17.440-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:09:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:09:47.635-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:09:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:10:17.903-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:10:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:10:48.240-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:10:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:11:18.518-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:11:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:11:48.793-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:11:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:12:19.079-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:12:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:12:49.367-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:12:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:13:19.525-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:13:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:13:49.749-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:13:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:14:20.020-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:14:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:14:50.326-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:14:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:15:20.634-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:15:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:15:50.907-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:15:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:16:21.191-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:16:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:16:51.456-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:16:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:17:21.738-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:17:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:17:52.040-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:17:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:18:22.357-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:18:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:18:52.515-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:18:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:19:22.821-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:19:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:19:53.113-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:19:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:20:23.295-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:20:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:20:53.581-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:20:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:21:23.889-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:21:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:21:54.176-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:21:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:22:24.395-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:22:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:22:54.741-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:22:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:23:25.018-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:23:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:23:55.307-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:23:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:24:25.517-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:24:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:24:55.981-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:24:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:25:26.366-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:25:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:25:56.526-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:25:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:26:26.831-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:26:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:26:57.116-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:26:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:27:27.255-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:27:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:27:57.543-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:27:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:28:27.837-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:28:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:28:58.098-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:28:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:29:28.416-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:29:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:29:58.685-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:29:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:30:28.964-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:30:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:30:59.323-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:30:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:31:29.617-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:31:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:31:59.897-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:31:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:32:30.485-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:32:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:33:00.769-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:33:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:33:31.001-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:33:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:34:01.304-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:34:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:34:31.590-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:34:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:35:01.917-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:35:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:35:32.110-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:35:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:36:02.394-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:36:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:36:32.662-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:36:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:37:02.849-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:37:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:37:33.129-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:37:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:38:03.412-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:38:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:38:33.764-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:38:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:39:03.980-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:39:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:39:34.372-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:39:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:40:04.539-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:40:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:40:34.888-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:40:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:41:05.156-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:41:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:41:35.496-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:41:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:42:05.836-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:42:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:42:36.241-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:42:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:43:06.618-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:43:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:43:36.918-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:43:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:44:07.191-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:44:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:44:37.392-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:44:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:45:07.722-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:45:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:45:37.934-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:45:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:46:08.098-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:46:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:46:38.423-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:46:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:47:08.699-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:47:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:47:39.000-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:47:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:48:09.390-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:48:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:48:39.805-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:48:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:49:10.071-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:49:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:49:40.355-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:49:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:50:10.718-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:50:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:50:40.997-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:50:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:51:11.297-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:51:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:51:41.690-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:51:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:52:12.053-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:52:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:52:42.204-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:52:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:53:12.373-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:53:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:53:42.733-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:53:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:54:13.014-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:54:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:54:43.216-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:54:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:55:13.363-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:55:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:55:43.637-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:55:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:56:14.010-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:56:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:56:44.281-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:56:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:57:14.606-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:57:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:57:44.879-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:57:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:58:15.182-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:58:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:58:45.489-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:58:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:59:16.594-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:59:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T17:59:46.771-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 17:59:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:00:17.005-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:00:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:00:47.287-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:00:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:01:17.584-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:01:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:01:47.870-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:01:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:02:18.150-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:02:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:02:48.443-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:02:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:03:18.701-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:03:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:03:48.996-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:03:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:04:19.221-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:04:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:04:49.454-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:04:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:05:19.754-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:05:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:05:50.102-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:05:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:06:20.250-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:06:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:06:50.509-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:06:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:07:20.718-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:07:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:07:50.999-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:07:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:08:21.290-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:08:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:08:51.542-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:08:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:09:21.704-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:09:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:09:51.949-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:09:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:10:22.284-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:10:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:10:52.578-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:10:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:11:22.953-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:11:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:11:53.234-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:11:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:12:23.519-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:12:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:12:53.780-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:12:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:13:24.055-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:13:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:13:54.359-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:13:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:14:24.668-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:14:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:14:54.908-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:14:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:15:25.247-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:15:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:15:55.558-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:15:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:16:25.789-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:16:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:16:56.088-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:16:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:17:26.309-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:17:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:17:56.665-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:17:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:18:26.971-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:18:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:18:57.288-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:18:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:19:27.583-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:19:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:19:57.778-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:19:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:20:28.082-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:20:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:20:58.366-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:20:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:21:28.565-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:21:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:21:58.707-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:21:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:22:28.989-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:22:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:22:59.279-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:22:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:23:29.644-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:23:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:23:59.939-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:23:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:24:30.330-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:24:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:25:00.592-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:25:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:25:30.886-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:25:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:26:01.168-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:26:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:26:31.408-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:26:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:27:01.538-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:27:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:27:31.840-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:27:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:28:02.083-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:28:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:28:32.355-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:28:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:29:02.646-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:29:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:29:32.935-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:29:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:30:03.208-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:30:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:30:33.577-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:30:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:31:03.734-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:31:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:31:33.938-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:31:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:32:04.253-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:32:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:32:34.540-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:32:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:33:04.743-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:33:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:33:35.058-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:33:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:34:05.330-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:34:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:34:35.602-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:34:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:35:05.891-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:35:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:35:36.176-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:35:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:36:06.469-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:36:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:36:36.855-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:36:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:37:07.142-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:37:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:37:37.415-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:37:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:38:07.740-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:38:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:38:38.021-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:38:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:39:08.303-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:39:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:39:38.623-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:39:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:40:08.995-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:40:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:40:39.262-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:40:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:41:09.675-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:41:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:41:40.096-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:41:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:42:10.399-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:42:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:42:40.684-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:42:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:43:10.853-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:43:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:43:41.231-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:43:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:44:11.436-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:44:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:44:41.737-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:44:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:45:11.973-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:45:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:45:42.242-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:45:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:46:12.624-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:46:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:46:42.787-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:46:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:47:13.072-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:47:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:47:43.359-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:47:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:48:13.706-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:48:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:48:43.976-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:48:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:49:14.267-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:49:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:49:44.467-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:49:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:50:14.838-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:50:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:50:45.030-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:50:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:51:15.417-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:51:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:51:45.716-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:51:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:52:16.002-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:52:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:52:46.159-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:52:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:53:16.488-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:53:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:53:46.830-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:53:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:54:17.210-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:54:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:54:47.562-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:54:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:55:17.800-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:55:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:55:47.939-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:55:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:56:18.168-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:56:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:56:48.451-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:56:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:57:18.653-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:57:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:57:48.962-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:57:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:58:19.243-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:58:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:58:49.461-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:58:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:59:19.872-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:59:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T18:59:50.036-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 18:59:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:00:20.228-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:00:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:00:50.366-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:00:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:01:20.605-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:01:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:01:50.887-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:01:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:02:21.305-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:02:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:02:51.586-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:02:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:03:21.753-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:03:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:03:52.013-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:03:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:04:22.321-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:04:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:04:52.593-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:04:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:05:22.848-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:05:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:05:53.139-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:05:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:06:23.354-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:06:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:06:53.724-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:06:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:07:24.009-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:07:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:07:54.202-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:07:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:08:24.495-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:08:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:08:54.729-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:08:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:09:24.979-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:09:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:09:55.310-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:09:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:10:25.631-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:10:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:10:55.823-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:10:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:11:26.006-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:11:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:11:56.283-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:11:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:12:26.475-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:12:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:12:56.776-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:12:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:13:26.981-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:13:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:13:57.258-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:13:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:14:27.618-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:14:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:14:57.899-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:14:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:15:28.054-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:15:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:15:58.218-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:15:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:16:28.410-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:16:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:16:58.682-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:16:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:17:28.962-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:17:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:17:59.250-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:17:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:18:29.546-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:18:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:18:59.887-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:18:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:19:30.174-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:19:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:20:00.466-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:20:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:20:30.752-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:20:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:21:00.940-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:21:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:21:31.325-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:21:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:22:01.643-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:22:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:22:31.922-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:22:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:23:02.061-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:23:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:23:32.381-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:23:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:24:02.669-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:24:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:24:32.922-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:24:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:25:03.216-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:25:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:25:33.482-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:25:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:26:03.755-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:26:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:26:34.028-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:26:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:27:04.305-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:27:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:27:34.681-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:27:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:28:04.974-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:28:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:28:35.180-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:28:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:29:05.463-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:29:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:29:35.736-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:29:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:30:05.894-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:30:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:30:36.292-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:30:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:31:06.580-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:31:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:31:36.912-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:31:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:32:07.152-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:32:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:32:37.433-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:32:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:33:07.645-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:33:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:33:37.878-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:33:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:34:08.347-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:34:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:34:38.695-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:34:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:35:08.999-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:35:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:35:39.148-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:35:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:36:09.409-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:36:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:36:39.673-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:36:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:37:09.874-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:37:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:37:40.069-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:37:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:38:10.339-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:38:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:38:40.623-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:38:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:39:10.951-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:39:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:39:41.211-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:39:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:40:11.398-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:40:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:40:41.660-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:40:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:41:11.828-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:41:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:41:42.132-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:41:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:42:12.385-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:42:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:42:42.642-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:42:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:43:12.980-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:43:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:43:43.233-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:43:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:44:13.424-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:44:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:44:43.697-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:44:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:45:14.023-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:45:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:45:44.431-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:45:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:46:14.741-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:46:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:46:44.888-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:46:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:47:15.178-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:47:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:47:45.388-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:47:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:48:15.668-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:48:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:48:45.955-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:48:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:49:16.328-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:49:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:49:46.623-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:49:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:50:16.968-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:50:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:50:47.245-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:50:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:51:17.472-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:51:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:51:47.952-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:51:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:52:18.274-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:52:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:52:48.530-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:52:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:53:18.813-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:53:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:53:48.950-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:53:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:54:19.139-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:54:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:54:49.334-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:54:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:55:19.612-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:55:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:55:49.975-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:55:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:56:20.144-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:56:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:56:50.399-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:56:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:57:20.671-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:57:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:57:51.130-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:57:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:58:21.330-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:58:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:58:51.632-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:58:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:59:21.913-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:59:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T19:59:52.057-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 19:59:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:00:22.326-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:00:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:00:52.618-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:00:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:01:22.791-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:01:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:01:53.053-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:01:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:02:23.324-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:02:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:02:53.598-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:02:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:03:23.877-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:03:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:03:54.106-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:03:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:04:24.364-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:04:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:04:54.640-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:04:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:05:24.790-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:05:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:05:55.077-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:05:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:06:25.372-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:06:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:06:55.647-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:06:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:07:25.795-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:07:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:07:56.078-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:07:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:08:26.349-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:08:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:08:56.739-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:08:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:09:27.029-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:09:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:09:57.432-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:09:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:10:27.729-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:10:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:10:57.967-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:10:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:11:28.170-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:11:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:11:58.448-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:11:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:12:28.732-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:12:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:12:59.031-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:12:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:13:29.301-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:13:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:13:59.584-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:13:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:14:29.873-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:14:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:15:00.240-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:14:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:15:30.512-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:15:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:16:00.861-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:16:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:16:31.145-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:16:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:17:01.411-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:17:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:17:31.615-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:17:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:18:01.885-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:18:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:18:32.253-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:18:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:19:02.549-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:19:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:19:32.832-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:19:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:20:03.121-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:20:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:20:33.478-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:20:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:21:03.675-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:21:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:21:33.959-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:21:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:22:04.158-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:22:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:22:34.316-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:22:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:23:04.577-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:23:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:23:34.850-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:23:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:24:05.133-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:24:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:24:35.314-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:24:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:25:05.467-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:25:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:25:35.731-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:25:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:26:05.991-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:26:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:26:36.275-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:26:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:27:06.507-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:27:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:27:36.768-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:27:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:28:06.930-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:28:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:28:37.224-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:28:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:29:07.607-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:29:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:29:38.030-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:29:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:30:08.360-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:30:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:30:38.643-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:30:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:31:08.794-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:31:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:31:39.063-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:31:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:32:09.322-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:32:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:32:39.600-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:32:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:33:09.880-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:33:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:33:40.157-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:33:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:34:10.431-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:34:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:34:40.755-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:34:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:35:11.040-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:35:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:35:41.318-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:35:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:36:11.621-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:36:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:36:41.866-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:36:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:37:12.019-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:37:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:37:42.393-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:37:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:38:12.650-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:38:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:38:42.959-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:38:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:39:13.247-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:39:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:39:43.433-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:39:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:40:13.708-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:40:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:40:43.985-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:40:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:41:14.248-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:41:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:41:44.518-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:41:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:42:14.732-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:42:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:42:45.112-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:42:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:43:15.442-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:43:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:43:45.679-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:43:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:44:15.958-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:44:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:44:46.347-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:44:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:45:16.648-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:45:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:45:46.940-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:45:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:46:17.211-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:46:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:46:47.353-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:46:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:47:17.559-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:47:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:47:47.847-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:47:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:48:18.132-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:48:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:48:48.424-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:48:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:49:18.581-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:49:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:49:48.844-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:49:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:50:19.130-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:50:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:50:49.401-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:50:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:51:19.667-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:51:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:51:49.927-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:51:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:52:20.216-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:52:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:52:50.481-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:52:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:53:20.766-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:53:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:53:50.983-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:53:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:54:21.229-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:54:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:54:51.513-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:54:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:55:21.913-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:55:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:55:52.057-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:55:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:56:22.374-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:56:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:56:52.675-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:56:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:57:22.959-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:57:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:57:53.280-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:57:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:58:23.445-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:58:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:58:53.626-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:58:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:59:23.861-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:59:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T20:59:54.040-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 20:59:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:00:24.364-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:00:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:00:54.647-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:00:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:01:24.807-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:01:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:01:55.126-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:01:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:02:25.298-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:02:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:02:55.628-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:02:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:03:25.879-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:03:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:03:56.204-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:03:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:04:26.511-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:04:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:04:56.803-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:04:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:05:27.089-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:05:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:05:57.255-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:05:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:06:27.463-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:06:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:06:57.732-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:06:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:07:27.931-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:07:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:07:58.243-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:07:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:08:28.500-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:08:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:08:58.887-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:08:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:09:29.171-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:09:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:09:59.436-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:09:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:10:29.602-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:10:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:10:59.884-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:10:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:11:30.167-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:11:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:12:00.535-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:12:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:12:30.902-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:12:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:13:01.194-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:13:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:13:31.648-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:13:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:14:01.949-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:14:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:14:32.222-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:14:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:15:02.486-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:15:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:15:32.646-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:15:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:16:02.915-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:16:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:16:33.373-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:16:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:17:03.686-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:17:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:17:33.955-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:17:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:18:04.189-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:18:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:18:34.470-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:18:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:19:04.716-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:19:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:19:34.899-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:19:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:20:05.107-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:20:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:20:35.418-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:20:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:21:05.708-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:21:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:21:35.977-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:21:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:22:06.184-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:22:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:22:36.492-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:22:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:23:06.649-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:23:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:23:36.897-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:23:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:24:07.177-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:24:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:24:37.457-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:24:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:25:07.693-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:25:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:25:37.922-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:25:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:26:08.190-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:26:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:26:38.480-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:26:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:27:08.837-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:27:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:27:39.224-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:27:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:28:09.409-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:28:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:28:39.549-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:28:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:29:09.860-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:29:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:29:40.160-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:29:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:30:10.516-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:30:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:30:40.808-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:30:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:31:11.209-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:31:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:31:41.580-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:31:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:32:11.867-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:32:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:32:42.217-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:32:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:33:12.555-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:33:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:33:42.915-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:33:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:34:13.200-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:34:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:34:43.490-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:34:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:35:13.872-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:35:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:35:44.220-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:35:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:36:14.467-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:36:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:36:44.741-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:36:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:37:15.053-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:37:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:37:45.261-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:37:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:38:15.423-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:38:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:38:45.577-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:38:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:39:15.881-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:39:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:39:46.141-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:39:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:40:16.403-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:40:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:40:46.591-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:40:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:41:16.951-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:41:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:41:47.230-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:41:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:42:17.625-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:42:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:42:47.959-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:42:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:43:18.260-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:43:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:43:48.586-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:43:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:44:18.807-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:44:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:44:49.142-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:44:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:45:19.428-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:45:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:45:49.706-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:45:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:46:20.075-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:46:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:46:50.344-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:46:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:47:20.607-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:47:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:47:50.902-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:47:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:48:21.094-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:48:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:48:51.376-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:48:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:49:21.642-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:49:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:49:51.822-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:49:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:50:22.113-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:50:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:50:52.397-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:50:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:51:22.662-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:51:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:51:53.006-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:51:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:52:23.272-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:52:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:52:53.540-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:52:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:53:23.825-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:53:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:53:54.239-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:53:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:54:24.515-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:54:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:54:54.784-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:54:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:55:25.057-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:55:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:55:55.381-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:55:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:56:25.638-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:56:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:56:55.914-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:56:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:57:26.210-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:57:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:57:56.422-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:57:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:58:26.655-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:58:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:58:56.878-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:58:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:59:27.263-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:59:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T21:59:57.523-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 21:59:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:00:27.733-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:00:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:00:58.009-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:00:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:01:28.287-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:01:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:01:58.547-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:01:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:02:28.863-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:02:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:02:59.166-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:02:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:03:29.670-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:03:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:03:59.997-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:03:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:04:30.290-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:04:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:05:00.661-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:05:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:05:30.798-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:05:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:06:00.994-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:06:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:06:31.295-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:06:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:07:01.635-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:07:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:07:31.899-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:07:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:08:02.193-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:08:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:08:32.479-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:08:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:09:02.836-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:09:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:09:33.181-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:09:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:10:03.513-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:10:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:10:33.798-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:10:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:11:03.995-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:11:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:11:34.276-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:11:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:12:04.491-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:12:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:12:34.763-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:12:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:13:05.062-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:13:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:13:35.320-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:13:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:14:05.497-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:14:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:14:35.892-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:14:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:15:06.158-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:15:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:15:36.424-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:15:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:16:06.800-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:16:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:16:37.079-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:16:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:17:07.253-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:17:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:17:37.533-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:17:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:18:07.800-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:18:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:18:38.109-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:18:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:19:08.395-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:19:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:19:38.540-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:19:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:20:08.833-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:20:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:20:39.118-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:20:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:21:09.417-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:21:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:21:39.781-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:21:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:22:10.053-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:22:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:22:40.420-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:22:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:23:10.701-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:23:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:23:40.968-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:23:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:24:11.265-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:24:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:24:41.450-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:24:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:25:11.762-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:25:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:25:42.052-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:25:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:26:12.322-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:26:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:26:42.670-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:26:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:27:12.988-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:27:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:27:43.265-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:27:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:28:13.405-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:28:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:28:43.746-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:28:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:29:13.904-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:29:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:29:44.187-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:29:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:30:14.598-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:30:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:30:44.970-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:30:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:31:15.264-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:31:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:31:45.409-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:31:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:32:15.695-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:32:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:32:45.983-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:32:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:33:16.269-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:33:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:33:46.536-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:33:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:34:16.928-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:34:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:34:47.097-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:34:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:35:17.424-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:35:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:35:47.577-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:35:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:36:17.870-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:36:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:36:48.151-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:36:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:37:18.587-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:37:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:37:48.730-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:37:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:38:19.012-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:38:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:38:49.170-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:38:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:39:19.503-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:39:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:39:49.787-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:39:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:40:19.971-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:40:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:40:50.232-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:40:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:41:20.570-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:41:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:41:50.863-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:41:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:42:21.058-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:42:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:42:51.313-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:42:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:43:21.728-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:43:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:43:51.943-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:43:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:44:22.209-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:44:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:44:52.497-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:44:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:45:22.708-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:45:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:45:52.983-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:45:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:46:23.256-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:46:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:46:53.542-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:46:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:47:23.726-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:47:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:47:54.012-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:47:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:48:24.319-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:48:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:48:54.596-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:48:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:49:24.864-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:49:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:49:55.247-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:49:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:50:25.386-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:50:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:50:55.672-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:50:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:51:26.098-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:51:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:51:56.478-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:51:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:52:26.775-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:52:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:52:57.079-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:52:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:53:27.402-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:53:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:53:57.531-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:53:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:54:27.924-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:54:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:54:58.256-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:54:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:55:28.607-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:55:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:55:58.932-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:55:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:56:29.225-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:56:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:56:59.447-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:56:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:57:29.742-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:57:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:57:59.992-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:57:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:58:30.276-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:58:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:59:00.569-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:59:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T22:59:30.752-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 22:59:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:00:01.129-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:00:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:00:31.337-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:00:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:01:01.614-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:01:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:01:31.813-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:01:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:02:02.114-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:02:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:02:32.375-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:02:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:03:02.614-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:03:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:03:32.913-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:03:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:04:03.264-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:04:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:04:33.574-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:04:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:05:03.822-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:05:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:05:34.083-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:05:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:06:04.373-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:06:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:06:34.524-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:06:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:07:04.684-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:07:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:07:34.972-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:07:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:08:05.267-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:08:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:08:35.458-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:08:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:09:05.731-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:09:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:09:36.066-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:09:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:10:06.306-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:10:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:10:36.569-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:10:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:11:06.870-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:11:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:11:37.205-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:11:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:12:07.408-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:12:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:12:37.543-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:12:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:13:07.916-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:13:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:13:38.213-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:13:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:14:08.419-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:14:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:14:38.605-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:14:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:15:08.934-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:15:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:15:39.127-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:15:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:16:09.365-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:16:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:16:39.652-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:16:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:17:09.964-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:17:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:17:40.227-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:17:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:18:10.540-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:18:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:18:40.808-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:18:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:19:11.146-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:19:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:19:41.277-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:19:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:20:11.514-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:20:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:20:41.780-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:20:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:21:11.993-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:21:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:21:42.182-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:21:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:22:12.412-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:22:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:22:42.607-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:22:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:23:12.899-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:23:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:23:43.184-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:23:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:24:13.355-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:24:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:24:43.647-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:24:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:25:13.920-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:25:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:25:44.253-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:25:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:26:14.556-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:26:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:26:44.847-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:26:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:27:15.130-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:27:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:27:45.389-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:27:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:28:15.651-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:28:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:28:46.019-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:28:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:29:16.411-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:29:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:29:46.704-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:29:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:30:17.007-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:30:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:30:47.272-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:30:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:31:17.531-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:31:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:31:47.687-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:31:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:32:17.944-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:32:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:32:48.313-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:32:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:33:18.669-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:33:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:33:49.050-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:33:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:34:19.427-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:34:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:34:49.605-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:34:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:35:19.892-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:35:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:35:50.152-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:35:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:36:20.458-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:36:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:36:50.635-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:36:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:37:20.944-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:37:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:37:51.218-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:37:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:38:21.549-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:38:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:38:51.824-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:38:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:39:22.212-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:39:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:39:52.535-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:39:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:40:22.940-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:40:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:40:53.113-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:40:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:41:23.523-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:41:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:41:53.888-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:41:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:42:24.244-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:42:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:42:54.399-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:42:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:43:24.623-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:43:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:43:54.771-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:43:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:44:24.922-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:44:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:44:55.096-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:44:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:45:25.280-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:45:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:45:55.552-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:45:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:46:25.757-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:46:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:46:56.080-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:46:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:47:26.386-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:47:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:47:56.655-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:47:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:48:26.857-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:48:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:48:57.160-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:48:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:49:27.357-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:49:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:49:57.547-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:49:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:50:27.823-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:50:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:50:58.181-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:50:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:51:28.416-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:51:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:51:58.774-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:51:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:52:29.066-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:52:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:52:59.323-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:52:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:53:29.616-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:53:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:53:59.821-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:53:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:54:30.129-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:54:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:55:00.461-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:55:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:55:30.756-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:55:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:56:00.906-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:56:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:56:31.172-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:56:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:57:01.446-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:57:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:57:31.732-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:57:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:58:02.036-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:58:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:58:32.366-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:58:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:59:02.641-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:59:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-23T23:59:32.901-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 23 23:59:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:00:03.241-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:00:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:00:33.483-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:00:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:00:34.226-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5886df71b081817bb2461c02') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485234034112), why: "doing balance round", ts: ObjectId('5886df729527cdec667c0f0a') } } gle1: { lastOp: Timestamp 1485154795000|16, connectionId: 21778, updatedExisting: false, n: 0, syncMillis: 31, writtenTo: null, err: null, waited: 31, ok: 1.0 } gle2: { lastOp: Timestamp 1485234034000|4, connectionId: 6379656, updatedExisting: true, n: 1, syncMillis: 24, writtenTo: null, err: null, waited: 24, ok: 1.0 } 2017-01-24T00:00:34.233-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-24T00:00:34.233-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:01:03.768-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:01:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:01:03.768-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-24T00:01:03.905-0500 [LockPinger] handled late remove of old distributed lock with ts 5886df729527cdec667c0f0a 2017-01-24T00:01:16.844-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:01:16.844-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:01:34.189-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:01:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:01:41.364-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886dfb59527cdec667c0f0c 2017-01-24T00:01:41.927-0500 [Balancer] ChunkManager: time to load chunks for historyDb.History: 87ms sequenceNumber: 6 version: 3285|17||55c0dbaf5b591f0b0cfcee5f based on: 3285|1||55c0dbaf5b591f0b0cfcee5f 2017-01-24T00:01:42.170-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T00:02:04.413-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:02:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:02:06.821-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886dfce9527cdec667c0f0d 2017-01-24T00:02:07.396-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T00:02:31.910-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886dfe79527cdec667c0f0e 2017-01-24T00:02:32.511-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T00:02:34.696-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:02:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:02:38.840-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886dfee9527cdec667c0f0f 2017-01-24T00:02:39.491-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T00:02:51.932-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5886dffb8d061be02ac6b844') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485234171786), why: "doing balance round", ts: ObjectId('5886dffb9527cdec667c0f10') } } gle1: { lastOp: Timestamp 1485234171000|35, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 26, writtenTo: null, err: null, waited: 26, ok: 1.0 } gle2: { lastOp: Timestamp 1485234159000|23, connectionId: 393608, updatedExisting: false, n: 0, syncMillis: 24, writtenTo: null, err: null, waited: 24, ok: 1.0 } 2017-01-24T00:02:51.939-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-24T00:02:51.939-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:02:58.199-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886e0029527cdec667c0f11 2017-01-24T00:02:58.730-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T00:03:04.877-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:03:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:03:04.877-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-24T00:03:04.989-0500 [LockPinger] handled late remove of old distributed lock with ts 5886dffb9527cdec667c0f10 2017-01-24T00:03:17.336-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886e0149527cdec667c0f12 2017-01-24T00:03:18.073-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T00:03:35.257-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:03:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:03:36.448-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886e0289527cdec667c0f13 2017-01-24T00:03:37.043-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T00:03:49.305-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5886e034cc8d2c984db59dd8') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485234229226), why: "doing balance round", ts: ObjectId('5886e0359527cdec667c0f14') } } gle1: { lastOp: Timestamp 1485234229000|5, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 11, writtenTo: null, err: null, waited: 11, ok: 1.0 } gle2: { lastOp: Timestamp 1485234216000|39, connectionId: 393608, updatedExisting: false, n: 0, syncMillis: 8, writtenTo: null, err: null, waited: 8, ok: 1.0 } 2017-01-24T00:03:49.314-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-24T00:03:49.414-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886e0359527cdec667c0f14 2017-01-24T00:03:50.125-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T00:03:56.454-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886e03c9527cdec667c0f15 2017-01-24T00:03:57.082-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T00:04:05.613-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:04:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:04:35.919-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:04:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:04:39.848-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886e0679527cdec667c0f16 2017-01-24T00:04:40.375-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T00:04:46.749-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:04:46.749-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:05:06.140-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:05:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:05:11.163-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:05:11.164-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:05:17.362-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:05:17.362-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:05:23.778-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886e0939527cdec667c0f1a 2017-01-24T00:05:24.457-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T00:05:30.789-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886e09a9527cdec667c0f1b 2017-01-24T00:05:31.431-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T00:05:36.271-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:05:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:05:37.652-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886e0a19527cdec667c0f1c 2017-01-24T00:05:38.216-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T00:06:06.550-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:06:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:06:08.680-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:06:08.680-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:06:36.696-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:06:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:06:39.148-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:06:39.148-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:07:06.967-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:07:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:07:37.098-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:07:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:07:46.115-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:07:46.115-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:08:07.414-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:08:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:08:16.640-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:08:16.641-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:08:23.011-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886e1469527cdec667c0f21 2017-01-24T00:08:23.759-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T00:08:37.695-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:08:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:09:00.427-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886e16c9527cdec667c0f22 2017-01-24T00:09:01.023-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T00:09:07.266-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886e1739527cdec667c0f23 2017-01-24T00:09:07.872-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T00:09:07.980-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:09:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:09:38.328-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:09:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:09:44.569-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886e1989527cdec667c0f24 2017-01-24T00:09:45.308-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T00:10:08.598-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:10:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:10:39.074-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:10:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:10:58.395-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:10:58.395-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:11:09.415-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:11:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:11:39.712-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:11:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:12:10.021-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:12:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:12:23.786-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:12:23.786-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:12:36.175-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:12:36.175-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:12:40.241-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:12:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:13:00.569-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5886e25bb3cf2809cb161bda') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485234780443), why: "doing balance round", ts: ObjectId('5886e25c9527cdec667c0f28') } } gle1: { lastOp: Timestamp 1485234780000|11, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 10, writtenTo: null, err: null, waited: 10, ok: 1.0 } gle2: { lastOp: Timestamp 1485234585000|10, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 15, writtenTo: null, err: null, waited: 15, ok: 1.0 } 2017-01-24T00:13:00.576-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-24T00:13:00.576-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:13:10.539-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:13:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:13:10.539-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-24T00:13:10.783-0500 [LockPinger] handled late remove of old distributed lock with ts 5886e25c9527cdec667c0f28 2017-01-24T00:13:25.180-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886e2749527cdec667c0f29 2017-01-24T00:13:25.780-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T00:13:32.118-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886e27b9527cdec667c0f2a 2017-01-24T00:13:32.794-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T00:13:41.139-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:13:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:14:03.239-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5886e29a07880d6ccb6cada2') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485234843107), why: "doing balance round", ts: ObjectId('5886e29b9527cdec667c0f2b') } } gle1: { lastOp: Timestamp 1485234843000|8, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 22, writtenTo: null, err: null, waited: 22, ok: 1.0 } gle2: { lastOp: Timestamp 1485234812000|45, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 6, writtenTo: null, err: null, waited: 6, ok: 1.0 } 2017-01-24T00:14:03.247-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-24T00:14:03.247-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:14:11.425-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:14:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:14:11.425-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-24T00:14:11.566-0500 [LockPinger] handled late remove of old distributed lock with ts 5886e29b9527cdec667c0f2b 2017-01-24T00:14:41.862-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:14:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:14:52.032-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:14:52.032-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:15:12.006-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:15:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:15:16.409-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:15:16.410-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:15:42.295-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:15:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:16:12.568-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:16:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:16:42.843-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:16:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:17:13.172-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:17:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:17:43.326-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:17:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:18:13.578-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:18:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:18:36.841-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:18:36.841-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:18:43.867-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:18:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:18:55.162-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:18:55.162-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:19:07.420-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:19:07.420-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:19:14.074-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:19:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:19:37.890-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:19:37.890-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:19:44.349-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:19:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:19:56.213-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:19:56.213-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:20:14.653-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:20:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:20:44.880-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:20:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:21:09.323-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:21:09.323-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:21:15.161-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:21:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:21:45.472-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:21:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:21:57.937-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:21:57.937-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:22:04.141-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:22:04.141-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:22:10.340-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:22:10.340-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:22:15.832-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:22:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:22:28.672-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:22:28.672-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:22:40.874-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:22:40.874-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:22:46.123-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:22:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:23:16.276-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:23:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:23:29.688-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:23:29.688-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:23:46.561-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:23:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:24:16.861-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:24:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:24:47.141-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:24:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:24:54.906-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886e5269527cdec667c0f3a 2017-01-24T00:24:55.442-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T00:25:17.419-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:25:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:25:32.198-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886e54b9527cdec667c0f3b 2017-01-24T00:25:32.904-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T00:25:47.678-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:25:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:25:51.416-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886e55f9527cdec667c0f3c 2017-01-24T00:25:52.080-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T00:26:04.753-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886e56c9527cdec667c0f3d 2017-01-24T00:26:05.320-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T00:26:17.986-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:26:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:26:35.812-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886e58b9527cdec667c0f3e 2017-01-24T00:26:36.413-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T00:26:48.272-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:26:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:27:07.019-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886e5aa9527cdec667c0f3f 2017-01-24T00:27:07.645-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T00:27:18.414-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:27:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:27:48.812-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:27:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:27:50.259-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5886e5d5e964e70c464925f9') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485235670150), why: "doing balance round", ts: ObjectId('5886e5d69527cdec667c0f40') } } gle1: { lastOp: Timestamp 1485235670000|6, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 15, writtenTo: null, err: null, waited: 15, ok: 1.0 } gle2: { lastOp: Timestamp 1485235627000|16, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 6, writtenTo: null, err: null, waited: 6, ok: 1.0 } 2017-01-24T00:27:50.266-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-24T00:27:50.266-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:28:14.604-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:28:14.604-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:28:19.556-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:28:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:28:19.556-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-24T00:28:19.763-0500 [LockPinger] handled late remove of old distributed lock with ts 5886e5d69527cdec667c0f40 2017-01-24T00:28:26.815-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:28:26.815-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:28:50.027-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:28:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:29:20.380-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:29:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:29:46.006-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:29:46.006-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:29:50.623-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:29:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:30:21.011-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:30:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:30:51.180-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:30:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:31:11.104-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:31:11.104-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:31:21.464-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:31:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:31:29.484-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:31:29.484-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:31:51.683-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:31:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:32:22.043-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:32:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:32:24.359-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:32:24.359-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:32:36.545-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:32:36.545-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:32:52.329-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:32:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:33:22.564-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:33:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:33:25.409-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:33:25.409-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:33:52.785-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:33:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:33:56.040-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886e7439527cdec667c0f49 2017-01-24T00:33:56.673-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T00:34:08.963-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886e7509527cdec667c0f4a 2017-01-24T00:34:09.713-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T00:34:23.062-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:34:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:34:52.649-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886e77c9527cdec667c0f4b 2017-01-24T00:34:53.207-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T00:34:53.349-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:34:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:35:11.642-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886e78f9527cdec667c0f4c 2017-01-24T00:35:12.199-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T00:35:23.625-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:35:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:35:30.550-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:35:30.550-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:35:49.064-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886e7b49527cdec667c0f4e 2017-01-24T00:35:49.614-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T00:35:53.882-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:35:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:36:14.179-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:36:14.180-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:36:24.214-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:36:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:36:50.766-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:36:50.766-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:36:54.501-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:36:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:37:03.017-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:37:03.017-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:37:09.290-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:37:09.290-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:37:24.899-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:37:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:37:27.593-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:37:27.593-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:37:45.962-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886e8299527cdec667c0f54 2017-01-24T00:37:46.706-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T00:37:55.181-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:37:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:37:59.104-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886e8369527cdec667c0f55 2017-01-24T00:37:59.806-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T00:38:18.334-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886e84a9527cdec667c0f56 2017-01-24T00:38:19.021-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T00:38:25.342-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:38:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:38:37.377-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:38:37.377-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:38:55.640-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:38:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:39:01.691-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:39:01.691-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:39:25.940-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:39:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:39:38.296-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:39:38.296-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:39:50.626-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:39:50.626-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:39:56.238-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:39:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:40:26.525-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:40:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:40:51.381-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:40:51.382-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:40:56.823-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:40:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:41:15.774-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:41:15.774-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:41:27.173-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:41:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:41:28.072-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:41:28.072-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:41:46.555-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:41:46.555-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:41:57.455-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:41:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:41:58.886-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:41:58.886-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:42:27.780-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:42:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:42:58.082-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:42:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:43:28.483-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:43:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:43:58.835-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:43:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:44:29.025-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:44:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:44:59.305-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:44:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:45:07.167-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:45:07.167-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:45:13.328-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:45:13.328-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:45:29.700-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:45:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:45:31.682-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:45:31.682-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:45:59.871-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:45:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:46:30.211-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:46:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:47:00.495-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:47:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:47:09.017-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:47:09.017-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:47:30.657-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:47:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:48:00.982-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:48:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:48:09.786-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:48:09.786-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:48:16.005-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:48:16.006-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:48:28.311-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:48:28.311-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:48:31.147-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:48:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:49:01.420-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:49:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:49:31.841-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:49:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:50:01.986-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:50:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:50:05.662-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:50:05.663-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:50:32.268-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:50:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:51:02.547-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:51:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:51:32.851-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:51:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:52:03.201-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:52:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:52:33.536-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:52:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:53:03.812-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:53:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:53:32.322-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:53:32.322-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:53:34.096-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:53:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:54:04.285-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:54:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:54:33.272-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:54:33.272-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:54:34.694-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:54:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:54:39.482-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5886ec1e8d061be02ac6b89f') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485237279327), why: "doing balance round", ts: ObjectId('5886ec1f9527cdec667c0f6a') } } gle1: { lastOp: Timestamp 1485236298000|58, connectionId: 21778, updatedExisting: false, n: 0, syncMillis: 21, writtenTo: null, err: null, waited: 21, ok: 1.0 } gle2: { lastOp: Timestamp 1485237279000|30, connectionId: 393608, updatedExisting: true, n: 1, syncMillis: 11, writtenTo: null, err: null, waited: 11, ok: 1.0 } 2017-01-24T00:54:39.491-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-24T00:54:39.491-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:55:05.031-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:55:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:55:05.032-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-24T00:55:05.211-0500 [LockPinger] handled late remove of old distributed lock with ts 5886ec1f9527cdec667c0f6a 2017-01-24T00:55:34.362-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:55:34.362-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:55:35.573-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:55:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:55:58.712-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:55:58.712-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:56:05.931-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:56:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:56:36.342-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:56:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:56:59.775-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886ecab9527cdec667c0f6d 2017-01-24T00:57:00.400-0500 [Balancer] ChunkManager: time to load chunks for historyDb.History: 102ms sequenceNumber: 7 version: 3285|19||55c0dbaf5b591f0b0cfcee5f based on: 3285|17||55c0dbaf5b591f0b0cfcee5f 2017-01-24T00:57:00.615-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T00:57:06.611-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:57:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:57:06.974-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886ecb29527cdec667c0f6e 2017-01-24T00:57:07.643-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T00:57:36.915-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:57:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:58:07.163-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:58:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:58:08.377-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:58:08.377-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:58:26.758-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:58:26.758-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:58:32.953-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:58:32.953-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:58:37.436-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:58:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:58:39.341-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886ed0f9527cdec667c0f72 2017-01-24T00:58:39.908-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T00:59:07.721-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:59:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T00:59:10.494-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T00:59:10.494-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T00:59:38.578-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 00:59:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:00:08.846-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:00:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:00:17.527-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:00:17.527-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:00:39.126-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:00:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:00:54.196-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:00:54.196-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:01:09.399-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:01:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:01:36.802-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:01:36.803-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:01:39.675-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:01:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:02:09.842-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:02:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:02:19.575-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886edeb9527cdec667c0f77 2017-01-24T01:02:20.205-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T01:02:40.118-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:02:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:02:56.857-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886ee109527cdec667c0f78 2017-01-24T01:02:57.488-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T01:03:10.321-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:03:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:03:28.062-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5886ee2fbdc3c8c24d0e2312') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485237807868), why: "doing balance round", ts: ObjectId('5886ee2f9527cdec667c0f79') } } gle1: { lastOp: Timestamp 1485237777000|11, connectionId: 21778, updatedExisting: false, n: 0, syncMillis: 31, writtenTo: null, err: null, waited: 31, ok: 1.0 } gle2: { lastOp: Timestamp 1485237807000|31, connectionId: 6379656, updatedExisting: true, n: 1, syncMillis: 7, writtenTo: null, err: null, waited: 7, ok: 1.0 } 2017-01-24T01:03:28.074-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-24T01:03:28.205-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886ee2f9527cdec667c0f79 2017-01-24T01:03:28.882-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T01:03:35.218-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886ee369527cdec667c0f7a 2017-01-24T01:03:35.923-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T01:03:40.608-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:03:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:03:42.302-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886ee3e9527cdec667c0f7b 2017-01-24T01:03:42.936-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T01:04:10.817-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:04:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:04:41.082-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:04:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:05:11.326-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:05:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:05:14.255-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:05:14.255-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:05:26.539-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5886eea559739a5a2f71f6f7') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485237926371), why: "doing balance round", ts: ObjectId('5886eea69527cdec667c0f7d') } } gle1: { lastOp: Timestamp 1485237822000|19, connectionId: 21778, updatedExisting: false, n: 0, syncMillis: 71, writtenTo: null, err: null, waited: 71, ok: 1.0 } gle2: { lastOp: Timestamp 1485237926000|18, connectionId: 6379656, updatedExisting: true, n: 1, syncMillis: 9, writtenTo: null, err: null, waited: 9, ok: 1.0 } 2017-01-24T01:05:26.545-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-24T01:05:26.545-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:05:32.753-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:05:32.753-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:05:41.604-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:05:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:05:41.604-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-24T01:05:41.743-0500 [LockPinger] handled late remove of old distributed lock with ts 5886eea69527cdec667c0f7d 2017-01-24T01:06:12.001-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:06:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:06:42.302-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:06:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:06:51.903-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:06:51.903-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:07:12.691-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:07:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:07:16.307-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:07:16.307-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:07:22.487-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:07:22.487-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:07:42.968-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:07:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:08:13.265-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:08:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:08:43.572-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:08:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:09:13.864-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:09:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:09:44.167-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:09:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:09:48.241-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:09:48.241-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:10:00.533-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:10:00.533-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:10:14.571-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:10:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:10:18.913-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:10:18.913-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:10:37.246-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:10:37.246-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:10:44.854-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:10:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:11:13.987-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:11:13.987-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:11:15.253-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:11:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:11:26.386-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886f00e9527cdec667c0f87 2017-01-24T01:11:27.076-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T01:11:45.420-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:11:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:12:15.813-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:12:15.814-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:12:15.883-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:12:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:12:21.979-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:12:21.979-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:12:40.421-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:12:40.421-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:12:46.036-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:12:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:12:46.604-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:12:46.604-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:13:16.305-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:13:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:13:46.610-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:13:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:14:05.793-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:14:05.794-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:14:16.872-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:14:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:14:30.163-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:14:30.163-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:14:47.118-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:14:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:15:00.613-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:15:00.613-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:15:17.255-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:15:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:15:25.014-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:15:25.014-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:15:47.675-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:15:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:16:07.781-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:16:07.782-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:16:17.999-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:16:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:16:20.235-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886f1339527cdec667c0f91 2017-01-24T01:16:20.833-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T01:16:39.126-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:16:39.126-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:16:45.271-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:16:45.271-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:16:48.267-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:16:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:17:18.591-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:17:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:17:33.962-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886f17d9527cdec667c0f94 2017-01-24T01:17:34.491-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T01:17:48.887-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:17:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:17:52.905-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886f1909527cdec667c0f95 2017-01-24T01:17:53.544-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T01:18:12.094-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886f1a39527cdec667c0f96 2017-01-24T01:18:12.717-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T01:18:19.165-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:18:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:18:31.236-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886f1b69527cdec667c0f97 2017-01-24T01:18:31.915-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T01:18:49.452-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:18:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:18:50.277-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886f1ca9527cdec667c0f98 2017-01-24T01:18:50.925-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T01:19:19.597-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:19:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:19:27.444-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:19:27.444-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:19:50.045-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:19:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:19:51.971-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:19:51.971-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:20:10.314-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:20:10.314-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:20:16.521-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:20:16.521-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:20:20.360-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:20:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:20:47.019-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:20:47.019-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:20:50.520-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:20:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:21:05.286-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:21:05.286-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:21:20.804-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:21:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:21:51.167-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:21:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:22:00.092-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:22:00.092-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:22:21.417-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:22:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:22:42.743-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:22:42.743-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:22:51.712-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:22:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:23:01.075-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:23:01.075-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:23:21.983-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:23:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:23:37.770-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:23:37.770-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:23:43.970-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:23:43.970-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:23:52.277-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:23:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:23:56.194-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:23:56.194-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:24:22.529-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:24:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:24:45.332-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886f32d9527cdec667c0fa5 2017-01-24T01:24:45.963-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T01:24:52.803-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:24:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:25:10.388-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886f3469527cdec667c0fa6 2017-01-24T01:25:10.919-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T01:25:23.043-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:25:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:25:35.322-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886f35f9527cdec667c0fa7 2017-01-24T01:25:35.966-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T01:25:53.316-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:25:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:26:06.537-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5886f37d60734f9d7b22164f') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485239166302), why: "doing balance round", ts: ObjectId('5886f37e9527cdec667c0fa8') } } gle1: { lastOp: Timestamp 1485239166000|9, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 28, writtenTo: null, err: null, waited: 28, ok: 1.0 } gle2: { lastOp: Timestamp 1485239135000|34, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 6, writtenTo: null, err: null, waited: 6, ok: 1.0 } 2017-01-24T01:26:06.544-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-24T01:26:06.544-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:26:23.601-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:26:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:26:23.601-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-24T01:26:23.745-0500 [LockPinger] handled late remove of old distributed lock with ts 5886f37e9527cdec667c0fa8 2017-01-24T01:26:43.288-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:26:43.288-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:26:54.039-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:26:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:27:01.663-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:27:01.663-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:27:24.180-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:27:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:27:54.527-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:27:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:28:24.806-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:28:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:28:45.014-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:28:45.015-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:28:51.206-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:28:51.206-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:28:55.105-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:28:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:28:57.390-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:28:57.390-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:29:21.815-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:29:21.815-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:29:25.435-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:29:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:29:46.301-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:29:46.301-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:29:55.674-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:29:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:30:04.633-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:30:04.633-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:30:26.040-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:30:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:30:28.958-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:30:28.958-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:30:56.266-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:30:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:31:23.726-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:31:23.726-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:31:26.562-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:31:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:31:30.163-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886f4c19527cdec667c0fb3 2017-01-24T01:31:30.935-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T01:31:56.856-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:31:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:32:07.566-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886f4e79527cdec667c0fb4 2017-01-24T01:32:08.126-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T01:32:26.508-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:32:26.508-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:32:27.006-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:32:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:32:57.300-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:32:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:33:03.120-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:33:03.120-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:33:27.593-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:33:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:33:39.648-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:33:39.648-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:33:58.045-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:33:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:34:10.086-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:34:10.086-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:34:28.395-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:34:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:34:58.689-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:34:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:34:58.987-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:34:58.988-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:35:28.871-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:35:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:35:53.799-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:35:53.799-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:35:59.153-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:35:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:36:00.041-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:36:00.041-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:36:29.428-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:36:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:36:59.740-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:36:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:37:06.929-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:37:06.929-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:37:13.070-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:37:13.070-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:37:29.917-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:37:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:38:00.211-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:37:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:38:30.500-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:38:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:39:00.769-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:39:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:39:08.780-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:39:08.780-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:39:31.071-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:39:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:39:33.185-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5886f6a499af93d783279d18') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485239973022), why: "doing balance round", ts: ObjectId('5886f6a59527cdec667c0fbf') } } gle1: { lastOp: Timestamp 1485239973000|7, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 21, writtenTo: null, err: null, waited: 21, ok: 1.0 } gle2: { lastOp: Timestamp 1485239528000|2, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 24, writtenTo: null, err: null, waited: 24, ok: 1.0 } 2017-01-24T01:39:33.195-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-24T01:39:33.369-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886f6a59527cdec667c0fbf 2017-01-24T01:39:33.975-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T01:39:40.315-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886f6ac9527cdec667c0fc0 2017-01-24T01:39:41.046-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T01:40:01.329-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:40:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:40:05.603-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886f6c59527cdec667c0fc1 2017-01-24T01:40:06.273-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T01:40:31.590-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:40:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:41:01.934-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:41:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:41:13.474-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886f7099527cdec667c0fc2 2017-01-24T01:41:14.148-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T01:41:32.305-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:41:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:42:02.554-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:42:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:42:03.007-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886f73a9527cdec667c0fc3 2017-01-24T01:42:03.600-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T01:42:28.023-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:42:28.023-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:42:32.737-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:42:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:42:40.252-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:42:40.252-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:42:58.671-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:42:58.671-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:43:03.231-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:43:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:43:10.965-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:43:10.965-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:43:17.171-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:43:17.171-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:43:33.652-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:43:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:44:03.946-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:44:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:44:30.244-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:44:30.245-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:44:34.228-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:44:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:45:04.535-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:45:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:45:06.784-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:45:06.785-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:45:25.131-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:45:25.131-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:45:31.374-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:45:31.374-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:45:34.833-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:45:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:46:04.996-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:46:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:46:07.832-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:46:07.832-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:46:20.167-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:46:20.167-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:46:35.314-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:46:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:46:44.793-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:46:44.793-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:47:05.602-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:47:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:47:35.905-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:47:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:48:06.170-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:48:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:48:28.336-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886f8bc9527cdec667c0fd0 2017-01-24T01:48:28.984-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T01:48:36.529-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:48:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:48:59.587-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:48:59.587-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:49:07.004-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:49:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:49:36.471-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886f9009527cdec667c0fd2 2017-01-24T01:49:37.184-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T01:49:37.291-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:49:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:50:07.564-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:50:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:50:37.894-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:50:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:50:38.007-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:50:38.007-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:51:02.512-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:51:02.512-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:51:08.117-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:51:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:51:38.448-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:51:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:52:08.765-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:52:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:52:39.037-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:52:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:52:58.022-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:52:58.022-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:53:09.339-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:53:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:53:28.744-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886f9e89527cdec667c0fd6 2017-01-24T01:53:29.309-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T01:53:39.586-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:53:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:53:41.597-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:53:41.597-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:54:09.907-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:54:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:54:12.000-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:54:12.001-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:54:36.405-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5886fa2bf2367042e84ec417') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485240876268), why: "doing balance round", ts: ObjectId('5886fa2c9527cdec667c0fd9') } } gle1: { lastOp: Timestamp 1485240876000|13, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 19, writtenTo: null, err: null, waited: 19, ok: 1.0 } gle2: { lastOp: Timestamp 1485240809000|13, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 18, writtenTo: null, err: null, waited: 18, ok: 1.0 } 2017-01-24T01:54:36.414-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-24T01:54:36.554-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886fa2c9527cdec667c0fd9 2017-01-24T01:54:37.257-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T01:54:40.182-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:54:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:54:43.490-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:54:43.490-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:54:49.834-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886fa399527cdec667c0fdb 2017-01-24T01:54:50.410-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T01:54:56.751-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886fa409527cdec667c0fdc 2017-01-24T01:54:57.356-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T01:55:10.470-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:55:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:55:40.747-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:55:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:55:46.285-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5886fa719527cdec667c0fdd 2017-01-24T01:55:47.060-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-24T01:56:10.927-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:56:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:56:41.154-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:56:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:57:06.125-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:57:06.125-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:57:11.469-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:57:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:57:12.342-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:57:12.343-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:57:41.737-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:57:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:58:12.034-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:58:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:58:25.318-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:58:25.319-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:58:42.331-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:58:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:59:07.843-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:59:07.843-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T01:59:12.616-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:59:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:59:43.049-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 01:59:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T01:59:50.814-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-24T01:59:50.814-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-24T02:00:13.318-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:00:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:00:43.506-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:00:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:01:13.843-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:01:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:01:44.102-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:01:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:02:14.477-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:02:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:02:44.756-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:02:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:03:15.042-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:03:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:03:45.340-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:03:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:04:15.641-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:04:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:04:45.953-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:04:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:05:16.359-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:05:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:05:46.743-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:05:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:06:16.949-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:06:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:06:47.291-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:06:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:07:17.635-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:07:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:07:47.785-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:07:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:08:17.985-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:08:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:08:48.339-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:08:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:09:18.628-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:09:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:09:48.910-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:09:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:10:19.245-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:10:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:10:49.576-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:10:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:11:19.847-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:11:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:11:50.125-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:11:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:12:20.392-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:12:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:12:50.680-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:12:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:13:20.962-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:13:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:13:51.348-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:13:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:14:21.630-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:14:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:14:51.949-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:14:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:15:22.257-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:15:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:15:52.644-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:15:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:16:22.907-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:16:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:16:53.186-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:16:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:17:23.598-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:17:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:17:53.953-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:17:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:18:24.228-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:18:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:18:54.563-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:18:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:19:24.721-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:19:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:19:54.872-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:19:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:20:25.164-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:20:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:20:55.442-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:20:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:21:25.776-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:21:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:21:56.037-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:21:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:22:26.436-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:22:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:22:56.704-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:22:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:23:26.960-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:23:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:23:57.245-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:23:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:24:27.530-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:24:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:24:57.762-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:24:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:25:28.034-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:25:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:25:58.310-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:25:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:26:28.719-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:26:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:26:59.021-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:26:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:27:29.264-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:27:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:27:59.622-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:27:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:28:30.025-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:28:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:29:00.178-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:29:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:29:30.484-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:29:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:30:00.769-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:30:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:30:31.100-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:30:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:31:01.434-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:31:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:31:31.632-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:31:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:32:01.905-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:32:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:32:32.077-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:32:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:33:02.416-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:33:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:33:32.699-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:33:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:34:03.087-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:34:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:34:33.375-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:34:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:35:03.697-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:35:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:35:34.044-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:35:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:36:04.318-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:36:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:36:34.639-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:36:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:37:04.834-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:37:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:37:35.105-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:37:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:38:05.386-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:38:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:38:35.724-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:38:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:39:05.927-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:39:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:39:36.123-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:39:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:40:06.453-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:40:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:40:36.757-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:40:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:41:07.048-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:41:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:41:37.334-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:41:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:42:07.636-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:42:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:42:37.937-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:42:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:43:08.149-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:43:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:43:38.399-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:43:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:44:08.631-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:44:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:44:38.906-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:44:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:45:09.225-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:45:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:45:39.438-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:45:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:46:09.603-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:46:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:46:39.868-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:46:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:47:10.107-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:47:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:47:40.525-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:47:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:48:10.763-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:48:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:48:41.020-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:48:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:49:11.288-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:49:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:49:41.504-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:49:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:50:11.774-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:50:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:50:42.168-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:50:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:51:12.442-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:51:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:51:42.642-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:51:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:52:12.921-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:52:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:52:43.199-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:52:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:53:13.338-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:53:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:53:43.566-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:53:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:54:13.719-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:54:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:54:43.888-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:54:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:55:14.205-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:55:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:55:44.469-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:55:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:56:14.758-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:56:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:56:45.030-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:56:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:57:15.335-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:57:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:57:45.602-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:57:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:58:15.899-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:58:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:58:46.170-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:58:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:59:16.567-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:59:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T02:59:47.001-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 02:59:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:00:17.476-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:00:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:00:47.929-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:00:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:01:18.193-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:01:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:01:48.481-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:01:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:02:18.636-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:02:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:02:48.787-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:02:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:03:19.044-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:03:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:03:49.226-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:03:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:04:19.372-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:04:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:04:49.669-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:04:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:05:19.926-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:05:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:05:50.142-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:05:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:06:20.461-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:06:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:06:50.753-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:06:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:07:21.121-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:07:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:07:51.573-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:07:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:08:21.925-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:08:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:08:52.340-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:08:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:09:22.545-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:09:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:09:52.818-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:09:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:10:23.000-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:10:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:10:53.274-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:10:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:11:23.611-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:11:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:11:53.856-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:11:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:12:24.149-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:12:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:12:54.430-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:12:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:13:24.632-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:13:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:13:54.935-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:13:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:14:25.273-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:14:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:14:55.606-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:14:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:15:25.916-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:15:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:15:56.196-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:15:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:16:26.378-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:16:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:16:56.702-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:16:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:17:27.004-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:17:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:17:57.311-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:17:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:18:27.590-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:18:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:18:58.008-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:18:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:19:28.313-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:19:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:19:58.517-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:19:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:20:28.657-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:20:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:20:58.935-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:20:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:21:29.169-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:21:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:21:59.471-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:21:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:22:29.780-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:22:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:23:00.110-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:22:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:23:30.487-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:23:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:24:00.773-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:24:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:24:31.062-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:24:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:25:01.200-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:25:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:25:31.470-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:25:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:26:01.780-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:26:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:26:32.065-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:26:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:27:02.401-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:27:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:27:32.689-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:27:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:28:02.929-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:28:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:28:33.204-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:28:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:29:03.496-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:29:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:29:33.655-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:29:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:30:03.941-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:30:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:30:34.299-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:30:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:31:04.452-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:31:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:31:34.818-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:31:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:32:05.114-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:32:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:32:35.417-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:32:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:33:05.703-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:33:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:33:35.942-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:33:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:34:06.114-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:34:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:34:36.412-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:34:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:35:06.586-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:35:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:35:36.907-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:35:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:36:07.207-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:36:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:36:37.534-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:36:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:37:07.782-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:37:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:37:38.158-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:37:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:38:08.503-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:38:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:38:38.770-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:38:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:39:09.040-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:39:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:39:39.334-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:39:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:40:09.614-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:40:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:40:39.863-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:40:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:41:10.151-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:41:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:41:40.294-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:41:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:42:10.559-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:42:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:42:40.822-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:42:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:43:11.014-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:43:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:43:41.289-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:43:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:44:11.522-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:44:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:44:41.816-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:44:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:45:12.094-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:45:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:45:42.403-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:45:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:46:12.652-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:46:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:46:42.892-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:46:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:47:13.192-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:47:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:47:43.521-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:47:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:48:13.659-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:48:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:48:43.861-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:48:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:49:13.984-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:49:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:49:44.309-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:49:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:50:14.621-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:50:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:50:44.926-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:50:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:51:15.207-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:51:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:51:45.484-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:51:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:52:15.768-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:52:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:52:45.938-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:52:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:53:16.223-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:53:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:53:46.487-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:53:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:54:16.964-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:54:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:54:47.226-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:54:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:55:17.655-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:55:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:55:47.928-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:55:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:56:18.215-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:56:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:56:48.504-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:56:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:57:18.765-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:57:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:57:49.074-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:57:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:58:19.354-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:58:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:58:49.631-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:58:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:59:20.068-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:59:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T03:59:50.446-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 03:59:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:00:20.721-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:00:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:00:50.980-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:00:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:01:21.230-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:01:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:01:51.488-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:01:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:02:21.695-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:02:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:02:51.986-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:02:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:03:22.338-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:03:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:03:52.658-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:03:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:04:22.928-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:04:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:04:53.227-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:04:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:05:23.504-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:05:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:05:53.790-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:05:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:06:24.051-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:06:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:06:54.314-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:06:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:07:24.600-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:07:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:07:54.880-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:07:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:08:25.150-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:08:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:08:55.398-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:08:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:09:25.668-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:09:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:09:55.954-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:09:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:10:26.256-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:10:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:10:56.598-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:10:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:11:26.890-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:11:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:11:57.167-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:11:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:12:27.511-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:12:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:12:57.701-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:12:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:13:27.875-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:13:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:13:58.205-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:13:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:14:28.405-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:14:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:14:58.679-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:14:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:15:29.020-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:15:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:15:59.299-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:15:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:16:29.583-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:16:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:16:59.861-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:16:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:17:30.045-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:17:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:18:00.244-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:18:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:18:30.523-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:18:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:19:00.816-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:19:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:19:31.132-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:19:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:20:01.418-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:20:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:20:31.692-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:20:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:21:01.861-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:21:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:21:32.132-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:21:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:22:02.273-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:22:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:22:32.560-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:22:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:23:02.849-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:23:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:23:33.158-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:23:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:24:03.497-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:24:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:24:33.764-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:24:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:25:04.128-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:25:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:25:34.288-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:25:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:26:04.584-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:26:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:26:34.725-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:26:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:27:05.010-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:27:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:27:35.406-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:27:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:28:05.673-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:28:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:28:35.915-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:28:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:29:06.323-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:29:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:29:36.595-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:29:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:30:06.800-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:30:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:30:37.015-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:30:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:31:07.284-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:31:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:31:37.576-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:31:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:32:07.709-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:32:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:32:37.962-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:32:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:33:08.236-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:33:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:33:38.536-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:33:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:34:08.678-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:34:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:34:38.879-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:34:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:35:09.032-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:35:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:35:39.352-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:35:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:36:09.580-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:36:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:36:39.901-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:36:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:37:10.067-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:37:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:37:40.449-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:37:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:38:10.734-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:38:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:38:41.005-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:38:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:39:11.453-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:39:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:39:41.751-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:39:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:40:12.037-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:40:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:40:42.295-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:40:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:41:12.448-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:41:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:41:42.724-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:41:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:42:13.013-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:42:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:42:43.518-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:42:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:43:13.810-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:43:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:43:44.062-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:43:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:44:14.229-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:44:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:44:44.565-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:44:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:45:14.883-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:45:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:45:45.242-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:45:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:46:15.426-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:46:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:46:45.793-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:46:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:47:16.085-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:47:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:47:46.432-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:47:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:48:16.689-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:48:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:48:46.916-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:48:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:49:17.238-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:49:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:49:47.558-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:49:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:50:17.781-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:50:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:50:48.073-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:50:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:51:18.227-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:51:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:51:48.458-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:51:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:52:18.721-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:52:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:52:48.925-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:52:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:53:19.071-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:53:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:53:49.395-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:53:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:54:19.682-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:54:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:54:50.054-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:54:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:55:20.217-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:55:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:55:50.503-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:55:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:56:20.799-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:56:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:56:51.024-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:56:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:57:21.225-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:57:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:57:51.507-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:57:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:58:21.778-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:58:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:58:52.042-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:58:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:59:22.309-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:59:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T04:59:52.489-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 04:59:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:00:22.799-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:00:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:00:53.120-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:00:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:01:23.448-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:01:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:01:53.722-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:01:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:02:23.916-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:02:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:02:54.085-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:02:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:03:24.352-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:03:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:03:54.648-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:03:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:04:24.925-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:04:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:04:55.212-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:04:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:05:25.491-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:05:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:05:55.753-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:05:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:06:26.039-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:06:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:06:56.328-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:06:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:07:26.672-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:07:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:07:56.837-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:07:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:08:27.101-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:08:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:08:57.307-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:08:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:09:27.576-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:09:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:09:57.738-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:09:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:10:28.042-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:10:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:10:58.336-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:10:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:11:28.606-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:11:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:11:58.823-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:11:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:12:29.083-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:12:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:12:59.444-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:12:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:13:29.667-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:13:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:13:59.935-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:13:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:14:30.237-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:14:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:15:00.649-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:15:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:15:30.922-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:15:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:16:01.218-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:16:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:16:31.504-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:16:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:17:01.785-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:17:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:17:32.144-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:17:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:18:02.462-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:18:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:18:32.798-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:18:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:19:03.120-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:19:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:19:33.464-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:19:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:20:03.606-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:20:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:20:33.892-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:20:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:21:04.049-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:21:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:21:34.246-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:21:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:22:04.588-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:22:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:22:34.753-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:22:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:23:04.953-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:23:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:23:35.216-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:23:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:24:05.507-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:24:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:24:35.877-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:24:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:25:06.113-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:25:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:25:36.284-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:25:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:26:06.600-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:26:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:26:36.951-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:26:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:27:07.308-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:27:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:27:37.502-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:27:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:28:07.740-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:28:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:28:37.947-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:28:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:29:08.138-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:29:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:29:38.382-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:29:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:30:08.601-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:30:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:30:38.882-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:30:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:31:09.156-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:31:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:31:39.292-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:31:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:32:09.593-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:32:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:32:39.882-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:32:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:33:10.024-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:33:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:33:40.461-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:33:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:34:10.663-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:34:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:34:41.042-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:34:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:35:11.340-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:35:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:35:41.550-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:35:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:36:11.851-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:36:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:36:42.095-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:36:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:37:12.259-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:37:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:37:42.260-0500 [LockPinger] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-24T05:37:42.283-0500 [LockPinger] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-24T05:37:42.286-0500 [LockPinger] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-24T05:37:42.595-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:37:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:38:12.771-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:38:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:38:42.978-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:38:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:39:13.291-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:39:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:39:43.598-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:39:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:40:13.783-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:40:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:40:44.067-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:40:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:41:14.210-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:41:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:41:44.474-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:41:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:42:14.744-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:42:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:42:45.063-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:42:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:43:15.255-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:43:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:43:45.494-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:43:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:44:15.882-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:44:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:44:46.220-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:44:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:45:16.520-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:45:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:45:46.790-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:45:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:46:17.083-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:46:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:46:47.366-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:46:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:47:17.727-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:47:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:47:47.869-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:47:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:48:18.156-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:48:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:48:48.427-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:48:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:49:18.715-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:49:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:49:49.009-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:49:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:50:19.206-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:50:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:50:49.646-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:50:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:51:19.865-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:51:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:51:50.147-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:51:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:52:20.411-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:52:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:52:50.745-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:52:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:53:21.031-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:53:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:53:51.278-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:53:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:54:21.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:54:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:54:51.677-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:54:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:55:21.966-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:55:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:55:52.386-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:55:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:56:22.705-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:56:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:56:52.984-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:56:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:57:23.265-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:57:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:57:53.599-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:57:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:58:23.916-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:58:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:58:54.211-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:58:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:59:24.428-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:59:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T05:59:54.732-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 05:59:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:00:25.001-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:00:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:00:55.334-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:00:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:01:25.761-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:01:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:01:56.162-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:01:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:02:26.532-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:02:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:02:56.815-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:02:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:03:27.084-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:03:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:03:57.213-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:03:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:04:27.397-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:04:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:04:57.662-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:04:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:05:27.949-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:05:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:05:58.402-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:05:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:06:28.667-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:06:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:06:58.933-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:06:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:07:29.362-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:07:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:07:59.571-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:07:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:08:29.885-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:08:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:09:00.184-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:08:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:09:30.473-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:09:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:10:00.616-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:10:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:10:30.938-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:10:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:11:01.068-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:11:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:11:31.218-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:11:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:12:01.407-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:12:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:12:31.684-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:12:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:13:02.036-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:13:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:13:32.323-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:13:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:14:02.609-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:14:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:14:32.821-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:14:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:15:03.174-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:15:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:15:33.380-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:15:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:16:03.540-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:16:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:16:33.682-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:16:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:17:04.039-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:17:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:17:34.302-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:17:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:18:04.440-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:18:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:18:34.627-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:18:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:19:04.930-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:19:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:19:35.210-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:19:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:20:05.477-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:20:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:20:35.793-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:20:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:21:05.952-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:21:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:21:36.344-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:21:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:22:06.617-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:22:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:22:36.984-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:22:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:23:07.267-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:23:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:23:37.551-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:23:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:24:08.023-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:24:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:24:38.219-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:24:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:25:08.553-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:25:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:25:38.844-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:25:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:26:09.138-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:26:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:26:39.421-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:26:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:27:09.685-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:27:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:27:39.961-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:27:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:28:10.236-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:28:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:28:40.512-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:28:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:29:10.806-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:29:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:29:41.100-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:29:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:30:11.371-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:30:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:30:41.638-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:30:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:31:11.991-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:31:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:31:42.393-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:31:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:32:12.622-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:32:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:32:42.952-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:32:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:33:13.339-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:33:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:33:43.612-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:33:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:34:13.848-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:34:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:34:43.998-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:34:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:35:14.260-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:35:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:35:44.554-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:35:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:36:14.779-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:36:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:36:45.072-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:36:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:37:15.334-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:37:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:37:45.571-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:37:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:38:15.793-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:38:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:38:46.084-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:38:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:39:16.468-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:39:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:39:46.698-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:39:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:40:17.017-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:40:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:40:47.438-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:40:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:41:17.721-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:41:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:41:47.980-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:41:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:42:18.317-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:42:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:42:48.483-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:42:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:43:18.754-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:43:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:43:49.116-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:43:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:44:19.369-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:44:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:44:49.574-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:44:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:45:19.909-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:45:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:45:50.251-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:45:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:46:20.556-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:46:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:46:50.787-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:46:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:47:21.157-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:47:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:47:51.611-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:47:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:48:21.894-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:48:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:48:52.130-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:48:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:49:22.476-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:49:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:49:52.724-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:49:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:50:23.050-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:50:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:50:53.392-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:50:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:51:23.683-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:51:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:51:53.983-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:51:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:52:24.233-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:52:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:52:54.432-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:52:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:53:24.720-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:53:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:53:55.003-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:53:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:54:25.428-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:54:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:54:55.719-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:54:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:55:26.015-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:55:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:55:56.184-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:55:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:56:26.479-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:56:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:56:56.666-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:56:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:57:26.941-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:57:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:57:57.200-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:57:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:58:27.528-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:58:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:58:57.812-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:58:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:59:28.124-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:59:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T06:59:58.333-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 06:59:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:00:28.619-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:00:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:00:58.886-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:00:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:01:29.184-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:01:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:01:59.460-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:01:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:02:29.750-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:02:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:03:00.033-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:02:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:03:30.338-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:03:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:04:00.759-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:04:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:04:30.929-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:04:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:05:01.233-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:05:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:05:31.501-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:05:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:06:01.785-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:06:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:06:32.334-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:06:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:07:02.493-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:07:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:07:32.767-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:07:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:08:02.943-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:08:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:08:33.274-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:08:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:09:03.539-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:09:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:09:33.874-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:09:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:10:04.074-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:10:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:10:34.334-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:10:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:11:04.673-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:11:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:11:34.962-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:11:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:12:05.290-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:12:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:12:35.730-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:12:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:13:06.030-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:13:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:13:36.297-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:13:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:14:06.600-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:14:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:14:36.790-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:14:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:15:07.107-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:15:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:15:37.369-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:15:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:16:07.760-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:16:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:16:38.148-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:16:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:17:08.330-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:17:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:17:38.505-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:17:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:18:08.796-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:18:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:18:39.087-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:18:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:19:09.412-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:19:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:19:39.702-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:19:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:20:10.037-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:20:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:20:40.339-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:20:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:21:10.735-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:21:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:21:41.010-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:21:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:22:11.344-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:22:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:22:41.610-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:22:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:23:11.888-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:23:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:23:42.180-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:23:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:24:12.517-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:24:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:24:42.786-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:24:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:25:13.056-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:25:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:25:43.342-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:25:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:26:13.567-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:26:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:26:43.861-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:26:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:27:14.189-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:27:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:27:44.399-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:27:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:28:14.690-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:28:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:28:45.032-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:28:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:29:15.581-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:29:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:29:45.882-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:29:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:30:16.641-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:30:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:30:47.302-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:30:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:31:17.645-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:31:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:31:47.913-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:31:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:32:18.080-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:32:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:32:48.304-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:32:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:33:18.624-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:33:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:33:48.901-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:33:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:34:19.102-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:34:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:34:49.380-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:34:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:35:19.649-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:35:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:35:49.924-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:35:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:36:20.221-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:36:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:36:50.362-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:36:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:37:20.656-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:37:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:37:50.958-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:37:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:38:21.294-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:38:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:38:51.679-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:38:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:39:21.947-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:39:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:39:52.222-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:39:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:40:22.584-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:40:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:40:52.792-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:40:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:41:22.971-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:41:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:41:53.226-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:41:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:42:23.422-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:42:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:42:53.763-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:42:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:43:24.046-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:43:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:43:54.328-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:43:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:44:24.606-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:44:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:44:54.759-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:44:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:45:25.149-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:45:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:45:55.333-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:45:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:46:25.519-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:46:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:46:55.803-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:46:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:47:26.019-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:47:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:47:56.531-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:47:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:48:26.750-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:48:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:48:57.058-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:48:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:49:27.270-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:49:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:49:57.433-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:49:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:50:27.615-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:50:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:50:57.779-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:50:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:51:27.935-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:51:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:51:58.291-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:51:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:52:28.663-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:52:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:52:58.974-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:52:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:53:29.274-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:53:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:53:59.620-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:53:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:54:29.928-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:54:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:55:00.233-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:54:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:55:30.702-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:55:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:56:00.979-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:56:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:56:31.588-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:56:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:57:01.828-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:57:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:57:32.130-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:57:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:58:02.416-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:58:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:58:32.940-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:58:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:59:03.075-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:59:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T07:59:33.436-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 07:59:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:00:03.638-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:00:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:00:33.849-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:00:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:01:04.170-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:01:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:01:34.489-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:01:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:02:04.636-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:02:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:02:34.804-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:02:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:03:05.085-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:03:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:03:35.523-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:03:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:04:05.848-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:04:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:04:36.100-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:04:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:05:06.237-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:05:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:05:36.502-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:05:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:06:06.782-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:06:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:06:36.955-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:06:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:07:07.140-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:07:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:07:37.426-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:07:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:08:07.710-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:08:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:08:37.867-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:08:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:09:08.062-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:09:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:09:38.405-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:09:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:10:08.677-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:10:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:10:38.959-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:10:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:11:09.245-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:11:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:11:39.522-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:11:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:12:09.806-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:12:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:12:39.958-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:12:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:13:10.105-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:13:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:13:40.472-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:13:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:14:10.650-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:14:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:14:40.836-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:14:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:15:10.986-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:15:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:15:41.268-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:15:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:16:11.544-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:16:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:16:41.902-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:16:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:17:12.217-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:17:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:17:42.580-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:17:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:18:13.005-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:18:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:18:43.321-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:18:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:19:13.603-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:19:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:19:43.773-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:19:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:20:13.938-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:20:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:20:44.133-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:20:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:21:14.408-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:21:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:21:44.735-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:21:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:22:15.014-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:22:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:22:45.300-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:22:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:23:15.556-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:23:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:23:45.845-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:23:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:24:16.112-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:24:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:24:46.329-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:24:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:25:16.623-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:25:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:25:46.907-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:25:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:26:17.189-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:26:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:26:47.446-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:26:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:27:17.828-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:27:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:27:47.977-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:27:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:28:18.232-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:28:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:28:48.494-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:28:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:29:18.794-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:29:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:29:49.077-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:29:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:30:19.349-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:30:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:30:49.721-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:30:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:31:20.005-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:31:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:31:50.269-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:31:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:32:20.458-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:32:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:32:50.611-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:32:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:33:20.890-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:33:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:33:51.027-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:33:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:34:21.407-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:34:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:34:51.673-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:34:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:35:21.824-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:35:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:35:52.154-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:35:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:36:22.343-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:36:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:36:52.639-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:36:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:37:22.936-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:37:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:37:53.235-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:37:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:38:23.506-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:38:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:38:53.782-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:38:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:39:23.986-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:39:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:39:54.279-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:39:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:40:24.559-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:40:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:40:54.829-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:40:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:41:25.052-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:41:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:41:55.370-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:41:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:42:25.560-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:42:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:42:55.844-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:42:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:43:26.102-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:43:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:43:56.415-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:43:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:44:26.682-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:44:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:44:57.054-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:44:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:45:27.446-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:45:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:45:57.728-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:45:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:46:28.118-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:46:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:46:58.381-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:46:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:47:28.685-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:47:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:47:59.066-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:47:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:48:29.282-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:48:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:48:59.663-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:48:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:49:29.922-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:49:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:50:00.252-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:49:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:50:30.668-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:50:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:51:00.824-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:51:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:51:31.130-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:51:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:52:01.398-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:52:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:52:31.717-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:52:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:53:01.951-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:53:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:53:32.241-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:53:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:54:02.535-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:54:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:54:32.804-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:54:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:55:02.946-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:55:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:55:33.252-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:55:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:56:03.541-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:56:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:56:33.818-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:56:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:57:04.070-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:57:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:57:34.347-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:57:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:58:04.714-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:58:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:58:34.991-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:58:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:59:05.301-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:59:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T08:59:35.468-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 08:59:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:00:05.777-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:00:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:00:36.087-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:00:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:01:06.398-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:01:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:01:36.689-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:01:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:02:07.022-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:02:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:02:37.413-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:02:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:03:07.751-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:03:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:03:38.061-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:03:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:04:08.397-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:04:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:04:38.794-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:04:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:05:09.082-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:05:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:05:39.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:05:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:06:09.822-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:06:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:06:40.088-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:06:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:07:10.380-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:07:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:07:40.712-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:07:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:08:11.001-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:08:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:08:41.292-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:08:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:09:11.578-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:09:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:09:41.896-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:09:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:10:12.097-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:10:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:10:42.606-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:10:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:11:12.938-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:11:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:11:43.185-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:11:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:12:13.449-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:12:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:12:43.755-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:12:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:13:14.079-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:13:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:13:44.357-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:13:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:14:14.661-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:14:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:14:44.932-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:14:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:15:15.340-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:15:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:15:45.581-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:15:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:16:15.889-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:16:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:16:46.135-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:16:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:17:16.316-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:17:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:17:46.594-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:17:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:18:16.848-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:18:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:18:47.119-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:18:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:19:17.464-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:19:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:19:47.765-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:19:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:20:18.078-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:20:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:20:48.346-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:20:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:21:18.720-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:21:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:21:48.872-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:21:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:22:19.173-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:22:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:22:49.535-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:22:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:23:19.823-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:23:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:23:50.063-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:23:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:24:20.374-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:24:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:24:50.634-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:24:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:25:21.026-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:25:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:25:51.308-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:25:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:26:21.721-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:26:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:26:52.095-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:26:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:27:22.258-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:27:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:27:52.495-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:27:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:28:22.738-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:28:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:28:52.994-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:28:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:29:23.400-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:29:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:29:53.710-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:29:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:30:24.016-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:30:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:30:54.274-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:30:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:31:24.527-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:31:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:31:54.810-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:31:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:32:25.188-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:32:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:32:55.538-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:32:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:33:25.848-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:33:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:33:56.181-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:33:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:34:26.527-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:34:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:34:56.812-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:34:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:35:27.065-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:35:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:35:57.428-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:35:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:36:27.705-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:36:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:36:57.883-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:36:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:37:28.360-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:37:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:37:58.588-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:37:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:38:28.851-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:38:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:38:58.992-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:38:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:39:29.392-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:39:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:39:59.653-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:39:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:40:29.966-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:40:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:41:00.275-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:40:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:41:30.601-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:41:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:42:00.814-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:42:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:42:31.001-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:42:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:43:01.322-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:43:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:43:31.773-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:43:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:44:02.061-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:44:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:44:32.400-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:44:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:45:02.683-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:45:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:45:33.098-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:45:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:46:03.395-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:46:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:46:33.751-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:46:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:47:03.892-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:47:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:47:34.170-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:47:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:48:04.465-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:48:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:48:34.727-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:48:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:49:04.934-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:49:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:49:35.102-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:49:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:50:05.536-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:50:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:50:35.885-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:50:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:51:06.203-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:51:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:51:36.557-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:51:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:52:06.850-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:52:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:52:37.139-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:52:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:53:07.474-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:53:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:53:37.670-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:53:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:54:08.089-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:54:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:54:38.270-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:54:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:55:08.585-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:55:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:55:38.866-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:55:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:56:09.244-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:56:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:56:39.617-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:56:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:57:10.000-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:57:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:57:40.347-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:57:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:58:10.745-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:58:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:58:41.053-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:58:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:59:11.329-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:59:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T09:59:41.619-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 09:59:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:00:12.019-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:00:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:00:42.287-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:00:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:01:12.612-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:01:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:01:42.832-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:01:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:02:13.077-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:02:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:02:43.344-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:02:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:03:13.657-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:03:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:03:43.934-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:03:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:04:14.223-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:04:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:04:44.519-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:04:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:05:14.790-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:05:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:05:45.029-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:05:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:06:15.300-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:06:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:06:45.577-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:06:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:07:15.978-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:07:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:07:46.262-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:07:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:08:16.580-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:08:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:08:46.845-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:08:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:09:17.198-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:09:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:09:47.574-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:09:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:10:17.871-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:10:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:10:48.206-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:10:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:11:18.419-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:11:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:11:48.678-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:11:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:12:18.942-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:12:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:12:49.080-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:12:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:13:19.360-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:13:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:13:49.802-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:13:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:14:20.067-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:14:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:14:50.384-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:14:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:15:20.606-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:15:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:15:50.887-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:15:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:16:21.255-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:16:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:16:51.563-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:16:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:17:21.880-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:17:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:17:52.053-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:17:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:18:22.315-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:18:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:18:52.619-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:18:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:19:22.885-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:19:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:19:53.297-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:19:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:20:23.629-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:20:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:20:53.901-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:20:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:21:24.048-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:21:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:21:54.309-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:21:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:22:24.579-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:22:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:22:54.899-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:22:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:23:25.190-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:23:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:23:55.341-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:23:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:24:25.545-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:24:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:24:55.806-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:24:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:25:26.111-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:25:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:25:56.386-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:25:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:26:26.798-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:26:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:26:57.090-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:26:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:27:27.399-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:27:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:27:57.698-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:27:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:28:28.137-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:28:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:28:58.436-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:28:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:29:28.749-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:29:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:29:58.955-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:29:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:30:29.223-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:30:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:30:59.512-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:30:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:31:29.789-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:31:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:32:00.081-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:31:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:32:30.462-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:32:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:33:00.705-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:33:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:33:30.993-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:33:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:34:01.267-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:34:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:34:31.433-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:34:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:35:01.716-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:35:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:35:32.001-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:35:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:36:02.374-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:36:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:36:32.715-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:36:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:37:03.092-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:37:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:37:33.382-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:37:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:38:03.661-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:38:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:38:33.928-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:38:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:39:04.105-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:39:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:39:34.383-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:39:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:40:04.652-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:40:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:40:34.939-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:40:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:41:05.076-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:41:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:41:35.344-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:41:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:42:05.661-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:42:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:42:35.942-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:42:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:43:06.282-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:43:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:43:36.575-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:43:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:44:06.898-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:44:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:44:37.173-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:44:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:45:07.469-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:45:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:45:37.717-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:45:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:46:07.993-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:46:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:46:38.337-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:46:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:47:08.607-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:47:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:47:38.872-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:47:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:48:09.193-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:48:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:48:39.607-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:48:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:49:09.890-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:49:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:49:40.172-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:49:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:50:10.474-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:50:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:50:40.762-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:50:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:51:11.144-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:51:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:51:41.432-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:51:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:52:11.688-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:52:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:52:41.950-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:52:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:53:12.109-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:53:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:53:42.412-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:53:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:54:12.667-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:54:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:54:42.973-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:54:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:55:13.373-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:55:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:55:43.673-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:55:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:56:14.040-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:56:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:56:44.340-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:56:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:57:14.544-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:57:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:57:44.825-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:57:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:58:14.997-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:58:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:58:45.399-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:58:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:59:16.079-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:59:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T10:59:46.252-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 10:59:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:00:16.399-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:00:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:00:46.680-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:00:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:01:17.090-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:01:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:01:47.431-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:01:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:02:17.777-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:02:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:02:48.112-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:02:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:03:18.406-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:03:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:03:48.607-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:03:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:04:18.912-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:04:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:04:49.241-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:04:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:05:19.547-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:05:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:05:49.702-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:05:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:06:19.880-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:06:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:06:50.072-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:06:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:07:20.352-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:07:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:07:50.558-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:07:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:08:20.848-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:08:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:08:51.142-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:08:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:09:21.298-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:09:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:09:51.460-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:09:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:10:21.829-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:10:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:10:52.099-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:10:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:11:22.369-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:11:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:11:52.688-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:11:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:12:22.876-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:12:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:12:53.022-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:12:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:13:23.292-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:13:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:13:53.581-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:13:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:14:24.021-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:14:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:14:54.232-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:14:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:15:24.502-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:15:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:15:54.694-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:15:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:16:25.038-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:16:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:16:55.335-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:16:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:17:25.611-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:17:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:17:55.889-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:17:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:18:26.164-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:18:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:18:56.422-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:18:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:19:26.647-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:19:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:19:56.860-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:19:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:20:27.030-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:20:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:20:57.418-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:20:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:21:27.560-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:21:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:21:57.821-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:21:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:22:28.108-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:22:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:22:58.369-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:22:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:23:28.742-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:23:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:23:58.901-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:23:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:24:29.200-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:24:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:24:59.503-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:24:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:25:29.888-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:25:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:26:00.301-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:25:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:26:08.922-0500 [conn4] authenticate db: historyDb { authenticate: 1, user: "its_rw", nonce: "xxx", key: "xxx" } 2017-01-24T11:26:14.582-0500 [conn5] authenticate db: historyDb { authenticate: 1, user: "its_rw", nonce: "xxx", key: "xxx" } 2017-01-24T11:26:16.196-0500 [conn6] authenticate db: historyDb { authenticate: 1, user: "its_rw", nonce: "xxx", key: "xxx" } 2017-01-24T11:26:16.200-0500 [conn7] authenticate db: historyDb { authenticate: 1, user: "its_rw", nonce: "xxx", key: "xxx" } 2017-01-24T11:26:30.569-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:26:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:27:00.973-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:27:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:27:31.273-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:27:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:28:01.555-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:28:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:28:31.842-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:28:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:29:02.162-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:29:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:29:32.497-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:29:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:30:02.720-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:30:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:30:32.915-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:30:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:31:03.346-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:31:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:31:33.625-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:31:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:32:03.828-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:32:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:32:34.110-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:32:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:33:04.350-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:33:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:33:34.658-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:33:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:34:04.845-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:34:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:34:35.204-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:34:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:35:05.500-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:35:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:35:35.809-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:35:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:36:06.070-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:36:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:36:36.243-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:36:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:37:06.490-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:37:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:37:36.868-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:37:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:38:07.143-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:38:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:38:37.433-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:38:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:39:07.726-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:39:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:39:37.882-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:39:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:40:08.149-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:40:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:40:38.436-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:40:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:41:08.718-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:41:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:41:39.077-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:41:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:42:09.271-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:42:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:42:39.546-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:42:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:43:09.827-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:43:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:43:40.197-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:43:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:44:10.581-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:44:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:44:40.923-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:44:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:45:11.156-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:45:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:45:41.433-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:45:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:46:11.758-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:46:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:46:42.050-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:46:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:47:12.271-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:47:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:47:42.577-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:47:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:48:12.838-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:48:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:48:43.120-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:48:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:49:13.423-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:49:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:49:43.715-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:49:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:50:14.084-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:50:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:50:44.351-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:50:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:51:14.657-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:51:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:51:45.027-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:51:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:52:15.214-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:52:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:52:45.375-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:52:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:53:15.631-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:53:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:53:46.049-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:53:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:54:16.301-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:54:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:54:46.606-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:54:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:55:16.910-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:55:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:55:47.208-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:55:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:56:17.495-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:56:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:56:47.781-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:56:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:57:18.054-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:57:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:57:48.339-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:57:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:58:18.488-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:58:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:58:48.623-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:58:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:59:19.418-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:59:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T11:59:49.762-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 11:59:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:00:20.064-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:00:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:00:50.372-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:00:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:01:20.601-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:01:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:01:50.838-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:01:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:02:21.129-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:02:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:02:51.434-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:02:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:03:21.676-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:03:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:03:51.949-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:03:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:04:22.228-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:04:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:04:52.606-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:04:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:05:22.772-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:05:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:05:53.056-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:05:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:06:23.227-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:06:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:06:53.531-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:06:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:07:23.824-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:07:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:07:54.096-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:07:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:08:24.365-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:08:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:08:54.602-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:08:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:09:25.101-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:09:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:09:55.268-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:09:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:10:25.649-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:10:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:10:55.819-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:10:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:11:26.045-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:11:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:11:56.350-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:11:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:12:26.614-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:12:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:12:56.925-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:12:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:13:27.163-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:13:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:13:57.428-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:13:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:14:27.585-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:14:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:14:57.850-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:14:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:15:28.159-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:15:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:15:58.383-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:15:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:16:28.672-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:16:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:16:58.944-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:16:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:17:29.221-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:17:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:17:59.485-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:17:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:18:29.835-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:18:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:19:00.145-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:18:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:19:30.425-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:19:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:20:00.658-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:20:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:20:30.981-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:20:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:21:01.301-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:21:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:21:31.633-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:21:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:22:01.941-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:22:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:22:32.234-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:22:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:23:02.505-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:23:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:23:32.789-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:23:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:24:03.103-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:24:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:24:33.278-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:24:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:25:03.551-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:25:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:25:33.835-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:25:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:26:04.096-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:26:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:26:34.352-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:26:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:27:04.552-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:27:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:27:34.833-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:27:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:28:05.136-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:28:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:28:35.303-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:28:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:29:05.626-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:29:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:29:35.917-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:29:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:30:06.129-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:30:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:30:36.404-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:30:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:31:06.614-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:31:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:31:37.033-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:31:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:32:07.336-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:32:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:32:37.597-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:32:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:33:07.873-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:33:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:33:38.172-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:33:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:34:08.376-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:34:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:34:38.642-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:34:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:35:08.941-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:35:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:35:39.229-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:35:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:36:09.494-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:36:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:36:39.688-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:36:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:37:09.983-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:37:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:37:40.293-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:37:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:38:10.564-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:38:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:38:40.861-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:38:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:39:11.114-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:39:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:39:41.356-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:39:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:40:11.691-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:40:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:40:41.907-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:40:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:41:12.176-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:41:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:41:42.464-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:41:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:42:12.604-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:42:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:42:42.968-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:42:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:43:13.265-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:43:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:43:43.505-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:43:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:44:13.778-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:44:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:44:43.916-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:44:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:45:14.218-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:45:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:45:44.524-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:45:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:46:14.800-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:46:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:46:45.106-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:46:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:47:15.389-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:47:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:47:45.664-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:47:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:48:15.868-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:48:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:48:46.178-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:48:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:49:16.451-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:49:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:49:46.706-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:49:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:50:16.954-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:50:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:50:47.224-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:50:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:51:17.473-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:51:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:51:47.728-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:51:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:52:18.002-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:52:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:52:48.285-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:52:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:53:18.681-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:53:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:53:48.984-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:53:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:54:19.215-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:54:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:54:49.513-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:54:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:55:19.789-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:55:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:55:50.136-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:55:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:56:20.539-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:56:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:56:51.151-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:56:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:57:21.425-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:57:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:57:51.714-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:57:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:58:21.974-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:58:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:58:52.425-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:58:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:59:22.857-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:59:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T12:59:53.089-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 12:59:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:00:23.359-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:00:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:00:53.572-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:00:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:01:23.828-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:01:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:01:54.161-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:01:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:02:24.479-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:02:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:02:54.810-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:02:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:03:25.107-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:03:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:03:55.363-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:03:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:04:25.617-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:04:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:04:55.839-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:04:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:05:26.135-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:05:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:05:56.523-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:05:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:06:26.811-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:06:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:06:57.114-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:06:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:07:27.350-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:07:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:07:57.627-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:07:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:08:27.923-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:08:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:08:58.196-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:08:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:09:28.467-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:09:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:09:58.649-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:09:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:10:29.018-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:10:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:10:59.249-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:10:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:11:29.613-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:11:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:11:59.902-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:11:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:12:30.186-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:12:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:13:00.453-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:13:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:13:30.728-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:13:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:14:01.035-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:14:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:14:31.352-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:14:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:15:01.624-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:15:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:15:31.901-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:15:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:16:02.185-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:16:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:16:32.499-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:16:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:17:02.694-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:17:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:17:33.016-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:17:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:18:03.392-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:18:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:18:33.886-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:18:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:19:04.194-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:19:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:19:34.459-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:19:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:20:04.777-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:20:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:20:34.987-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:20:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:21:05.270-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:21:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:21:35.581-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:21:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:22:05.904-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:22:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:22:36.199-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:22:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:23:06.461-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:23:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:23:36.754-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:23:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:24:07.019-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:24:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:24:37.310-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:24:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:25:07.587-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:25:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:25:37.845-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:25:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:26:08.259-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:26:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:26:38.574-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:26:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:27:08.731-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:27:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:27:39.315-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:27:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:28:09.606-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:28:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:28:39.773-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:28:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:29:10.042-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:29:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:29:40.349-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:29:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:30:10.904-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:30:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:30:41.224-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:30:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:31:11.595-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:31:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:31:42.045-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:31:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:32:12.265-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:32:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:32:42.559-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:32:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:33:13.074-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:33:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:33:43.423-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:33:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:34:13.667-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:34:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:34:43.971-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:34:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:35:14.159-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:35:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:35:44.460-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:35:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:36:14.809-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:36:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:36:45.104-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:36:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:37:15.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:37:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:37:45.739-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:37:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:38:16.061-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:38:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:38:46.403-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:38:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:39:16.560-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:39:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:39:46.861-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:39:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:40:17.184-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:40:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:40:47.501-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:40:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:41:17.972-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:41:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:41:48.285-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:41:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:42:18.586-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:42:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:42:48.864-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:42:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:43:19.118-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:43:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:43:49.264-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:43:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:44:19.548-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:44:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:44:49.732-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:44:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:45:19.914-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:45:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:45:50.208-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:45:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:46:20.527-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:46:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:46:50.801-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:46:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:47:21.075-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:47:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:47:51.339-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:47:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:48:21.707-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:48:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:48:52.032-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:48:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:49:22.428-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:49:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:49:52.775-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:49:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:50:22.944-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:50:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:50:53.436-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:50:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:51:23.742-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:51:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:51:53.948-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:51:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:52:24.212-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:52:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:52:54.525-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:52:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:53:24.681-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:53:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:53:55.078-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:53:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:54:25.340-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:54:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:54:55.602-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:54:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:55:25.895-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:55:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:55:56.183-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:55:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:56:26.469-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:56:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:56:56.767-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:56:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:57:27.012-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:57:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:57:57.266-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:57:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:58:27.505-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:58:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:58:57.837-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:58:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:59:28.126-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:59:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T13:59:58.404-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 13:59:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:00:28.684-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:00:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:00:59.059-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:00:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:01:29.316-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:01:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:01:59.501-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:01:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:02:30.066-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:02:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:03:00.345-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:03:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:03:30.651-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:03:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:04:00.886-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:04:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:04:31.193-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:04:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:05:01.430-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:05:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:05:31.734-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:05:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:06:01.973-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:06:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:06:32.199-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:06:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:07:02.438-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:07:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:07:32.747-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:07:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:08:03.013-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:08:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:08:33.247-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:08:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:09:03.521-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:09:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:09:33.762-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:09:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:10:03.968-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:10:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:10:34.283-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:10:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:11:04.509-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:11:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:11:34.886-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:11:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:12:05.203-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:12:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:12:35.395-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:12:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:13:05.678-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:13:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:13:36.067-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:13:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:14:06.314-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:14:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:14:36.630-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:14:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:15:06.891-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:15:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:15:37.118-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:15:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:16:07.358-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:16:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:16:37.677-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:16:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:17:07.966-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:17:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:17:38.181-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:17:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:18:08.537-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:18:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:18:38.868-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:18:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:19:09.060-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:19:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:19:39.319-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:19:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:20:09.647-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:20:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:20:39.937-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:20:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:21:10.177-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:21:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:21:40.466-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:21:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:22:10.695-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:22:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:22:40.865-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:22:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:23:11.125-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:23:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:23:41.322-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:23:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:24:11.575-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:24:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:24:41.808-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:24:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:25:12.139-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:25:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:25:42.362-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:25:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:26:12.676-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:26:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:26:42.911-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:26:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:27:13.242-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:27:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:27:43.446-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:27:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:28:13.744-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:28:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:28:43.908-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:28:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:29:14.414-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:29:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:29:44.714-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:29:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:30:14.899-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:30:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:30:45.239-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:30:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:31:15.551-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:31:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:31:45.796-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:31:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:32:16.154-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:32:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:32:46.461-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:32:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:33:16.632-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:33:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:33:46.928-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:33:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:34:17.222-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:34:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:34:47.464-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:34:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:35:17.756-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:35:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:35:48.052-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:35:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:36:18.326-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:36:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:36:48.715-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:36:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:37:18.981-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:37:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:37:49.254-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:37:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:38:19.712-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:38:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:38:50.011-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:38:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:39:20.285-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:39:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:39:50.617-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:39:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:40:20.900-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:40:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:40:51.222-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:40:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:41:21.490-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:41:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:41:51.754-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:41:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:42:22.035-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:42:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:42:52.347-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:42:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:43:22.646-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:43:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:43:52.837-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:43:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:44:23.056-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:44:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:44:53.288-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:44:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:45:23.616-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:45:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:45:53.815-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:45:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:46:24.096-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:46:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:46:54.424-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:46:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:47:24.663-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:47:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:47:54.812-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:47:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:48:25.055-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:48:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:48:55.369-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:48:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:49:25.589-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:49:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:49:56.074-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:49:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:50:26.356-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:50:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:50:56.562-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:50:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:51:26.890-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:51:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:51:57.175-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:51:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:52:27.460-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:52:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:52:57.792-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:52:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:53:28.092-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:53:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:53:58.369-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:53:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:54:28.660-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:54:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:54:59.009-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:54:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:55:29.284-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:55:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:55:59.547-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:55:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:56:29.800-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:56:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:57:00.154-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:56:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:57:30.415-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:57:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:58:00.707-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:58:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:58:31.062-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:58:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:59:01.336-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:59:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T14:59:31.795-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 14:59:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:00:02.190-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:00:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:00:32.465-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:00:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:01:02.750-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:01:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:01:33.032-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:01:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:02:03.407-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:02:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:02:33.923-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:02:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:03:04.207-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:03:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:03:34.502-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:03:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:04:04.662-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:04:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:04:34.860-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:04:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:05:05.044-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:05:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:05:35.392-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:05:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:06:05.591-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:06:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:06:35.928-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:06:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:07:06.321-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:07:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:07:36.648-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:07:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:08:06.944-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:08:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:08:37.227-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:08:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:09:07.527-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:09:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:09:37.832-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:09:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:10:08.161-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:10:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:10:38.460-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:10:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:11:08.662-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:11:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:11:38.806-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:11:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:12:09.030-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:12:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:12:39.182-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:12:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:13:09.464-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:13:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:13:39.661-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:13:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:14:09.942-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:14:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:14:40.156-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:14:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:15:10.373-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:15:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:15:40.527-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:15:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:16:10.801-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:16:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:16:41.057-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:16:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:17:11.239-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:17:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:17:41.523-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:17:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:18:11.781-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:18:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:18:42.080-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:18:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:19:12.355-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:19:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:19:42.624-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:19:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:20:12.918-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:20:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:20:43.298-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:20:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:21:13.575-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:21:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:21:43.895-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:21:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:22:14.187-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:22:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:22:44.498-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:22:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:23:14.872-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:23:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:23:45.146-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:23:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:24:15.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:24:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:24:45.732-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:24:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:25:16.012-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:25:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:25:46.301-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:25:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:26:16.621-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:26:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:26:46.834-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:26:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:27:17.129-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:27:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:27:47.415-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:27:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:28:17.740-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:28:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:28:47.888-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:28:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:29:18.175-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:29:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:29:48.522-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:29:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:30:18.793-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:30:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:30:48.936-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:30:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:31:19.193-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:31:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:31:49.386-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:31:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:32:19.782-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:32:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:32:49.929-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:32:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:33:20.065-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:33:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:33:50.354-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:33:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:34:20.816-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:34:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:34:51.079-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:34:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:35:21.374-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:35:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:35:51.703-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:35:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:36:21.986-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:36:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:36:52.261-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:36:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:37:22.546-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:37:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:37:52.831-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:37:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:38:23.025-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:38:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:38:53.208-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:38:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:39:23.490-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:39:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:39:53.774-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:39:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:40:23.918-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:40:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:40:54.213-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:40:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:41:24.497-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:41:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:41:54.792-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:41:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:42:25.070-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:42:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:42:55.329-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:42:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:43:25.638-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:43:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:43:55.882-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:43:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:44:26.041-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:44:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:44:56.328-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:44:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:45:26.595-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:45:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:45:56.750-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:45:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:46:26.914-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:46:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:46:57.192-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:46:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:47:27.458-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:47:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:47:57.626-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:47:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:48:27.912-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:48:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:48:58.253-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:48:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:49:28.419-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:49:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:49:58.581-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:49:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:50:28.944-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:50:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:50:59.244-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:50:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:51:29.544-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:51:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:51:59.854-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:51:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:52:30.125-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:52:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:53:00.498-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:53:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:53:30.704-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:53:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:54:00.991-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:54:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:54:31.172-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:54:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:55:01.519-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:55:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:55:31.914-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:55:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:56:02.283-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:56:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:56:32.554-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:56:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:57:02.821-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:57:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:57:33.202-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:57:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:58:03.480-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:58:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:58:33.755-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:58:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:59:04.027-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:59:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T15:59:34.289-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 15:59:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:00:05.020-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:00:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:00:35.309-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:00:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:01:05.744-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:01:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:01:35.956-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:01:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:02:06.266-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:02:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:02:36.621-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:02:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:03:06.904-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:03:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:03:37.153-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:03:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:04:07.428-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:04:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:04:37.706-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:04:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:05:07.987-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:05:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:05:38.135-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:05:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:06:08.331-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:06:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:06:38.630-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:06:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:07:08.918-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:07:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:07:39.122-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:07:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:08:09.408-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:08:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:08:39.911-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:08:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:09:10.099-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:09:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:09:40.380-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:09:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:10:10.664-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:10:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:10:40.823-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:10:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:11:11.105-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:11:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:11:41.327-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:11:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:12:11.633-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:12:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:12:41.895-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:12:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:13:12.171-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:13:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:13:42.483-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:13:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:14:12.874-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:14:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:14:43.145-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:14:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:15:13.436-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:15:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:15:43.704-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:15:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:16:14.005-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:16:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:16:44.320-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:16:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:17:14.733-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:17:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:17:44.941-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:17:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:18:15.222-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:18:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:18:45.488-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:18:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:19:15.749-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:19:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:19:46.019-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:19:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:20:16.308-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:20:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:20:46.562-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:20:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:21:16.698-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:21:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:21:47.066-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:21:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:22:17.388-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:22:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:22:47.687-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:22:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:23:18.104-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:23:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:23:48.376-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:23:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:24:18.532-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:24:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:24:48.847-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:24:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:25:19.205-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:25:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:25:49.732-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:25:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:26:19.930-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:26:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:26:50.181-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:26:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:27:20.327-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:27:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:27:50.608-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:27:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:28:21.002-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:28:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:28:51.189-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:28:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:29:21.385-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:29:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:29:51.679-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:29:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:30:22.046-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:30:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:30:52.433-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:30:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:31:22.737-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:31:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:31:53.028-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:31:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:32:23.302-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:32:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:32:53.598-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:32:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:33:23.883-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:33:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:33:54.144-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:33:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:34:24.515-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:34:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:34:54.793-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:34:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:35:25.096-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:35:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:35:55.288-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:35:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:36:25.542-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:36:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:36:55.751-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:36:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:37:26.099-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:37:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:37:56.486-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:37:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:38:26.689-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:38:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:38:56.947-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:38:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:39:27.255-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:39:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:39:57.537-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:39:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:40:27.684-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:40:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:40:57.955-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:40:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:41:28.268-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:41:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:41:58.440-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:41:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:42:28.714-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:42:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:42:59.000-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:42:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:43:29.150-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:43:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:43:59.335-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:43:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:44:29.477-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:44:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:44:59.775-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:44:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:45:30.086-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:45:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:46:00.407-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:46:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:46:30.747-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:46:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:47:01.028-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:47:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:47:31.263-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:47:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:48:01.542-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:48:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:48:31.952-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:48:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:49:02.131-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:49:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:49:32.420-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:49:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:50:02.616-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:50:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:50:32.921-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:50:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:51:03.271-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:51:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:51:33.623-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:51:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:52:03.894-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:52:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:52:34.230-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:52:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:53:04.562-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:53:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:53:34.818-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:53:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:54:05.185-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:54:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:54:35.463-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:54:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:55:05.720-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:55:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:55:36.013-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:55:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:56:06.327-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:56:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:56:36.618-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:56:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:57:06.877-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:57:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:57:37.277-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:57:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:58:07.572-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:58:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:58:38.022-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:58:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:59:08.328-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:59:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T16:59:38.632-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 16:59:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:00:08.823-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:00:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:00:39.076-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:00:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:01:09.282-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:01:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:01:39.586-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:01:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:02:09.737-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:02:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:02:39.879-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:02:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:03:10.168-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:03:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:03:40.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:03:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:04:10.708-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:04:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:04:40.999-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:04:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:05:11.195-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:05:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:05:41.375-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:05:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:06:11.757-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:06:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:06:42.039-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:06:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:07:12.387-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:07:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:07:42.584-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:07:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:08:12.894-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:08:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:08:43.329-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:08:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:09:13.837-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:09:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:09:44.119-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:09:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:10:14.356-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:10:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:10:44.540-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:10:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:11:14.805-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:11:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:11:45.038-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:11:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:12:15.175-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:12:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:12:45.465-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:12:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:13:15.653-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:13:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:13:45.920-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:13:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:14:16.100-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:14:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:14:46.366-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:14:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:15:16.591-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:15:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:15:46.986-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:15:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:16:17.244-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:16:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:16:47.552-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:16:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:17:17.759-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:17:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:17:48.013-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:17:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:18:18.277-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:18:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:18:48.589-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:18:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:19:18.878-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:19:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:19:49.142-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:19:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:20:19.423-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:20:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:20:49.690-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:20:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:21:20.005-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:21:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:21:50.145-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:21:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:22:20.341-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:22:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:22:50.713-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:22:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:23:20.995-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:23:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:23:51.305-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:23:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:24:21.599-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:24:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:24:51.921-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:24:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:25:22.182-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:25:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:25:52.514-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:25:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:26:22.790-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:26:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:26:53.095-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:26:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:27:23.359-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:27:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:27:53.644-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:27:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:28:23.917-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:28:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:28:54.309-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:28:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:29:24.734-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:29:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:29:54.965-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:29:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:30:25.262-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:30:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:30:55.634-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:30:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:31:25.962-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:31:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:31:56.260-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:31:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:32:26.541-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:32:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:32:56.828-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:32:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:33:27.109-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:33:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:33:57.481-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:33:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:34:27.762-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:34:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:34:57.910-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:34:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:35:28.163-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:35:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:35:58.493-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:35:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:36:28.868-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:36:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:36:59.021-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:36:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:37:29.235-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:37:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:37:59.436-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:37:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:38:29.600-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:38:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:38:59.850-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:38:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:39:30.182-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:39:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:40:00.472-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:40:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:40:30.722-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:40:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:41:00.957-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:41:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:41:31.297-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:41:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:42:01.501-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:42:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:42:31.779-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:42:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:43:01.947-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:43:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:43:32.233-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:43:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:44:02.523-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:44:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:44:32.667-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:44:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:45:03.008-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:45:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:45:33.241-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:45:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:46:03.503-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:46:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:46:33.787-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:46:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:47:04.066-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:47:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:47:34.447-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:47:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:48:04.765-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:48:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:48:35.048-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:48:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:49:05.302-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:49:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:49:35.610-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:49:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:50:05.766-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:50:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:50:36.060-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:50:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:51:06.255-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:51:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:51:36.459-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:51:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:52:06.606-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:52:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:52:36.875-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:52:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:53:07.279-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:53:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:53:37.577-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:53:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:54:07.870-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:54:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:54:38.148-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:54:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:55:08.337-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:55:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:55:38.559-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:55:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:56:08.778-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:56:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:56:39.043-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:56:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:57:09.241-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:57:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:57:39.571-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:57:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:58:09.857-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:58:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:58:40.139-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:58:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:59:10.345-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:59:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T17:59:40.641-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 17:59:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:00:11.110-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:00:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:00:41.410-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:00:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:01:11.608-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:01:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:01:41.840-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:01:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:02:12.099-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:02:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:02:42.311-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:02:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:03:12.680-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:03:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:03:43.024-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:03:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:04:13.187-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:04:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:04:43.480-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:04:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:05:13.794-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:05:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:05:44.095-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:05:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:06:14.264-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:06:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:06:44.534-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:06:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:07:14.838-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:07:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:07:45.053-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:07:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:08:15.201-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:08:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:08:45.389-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:08:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:09:15.715-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:09:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:09:45.997-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:09:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:10:16.260-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:10:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:10:46.633-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:10:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:11:16.769-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:11:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:11:47.049-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:11:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:12:17.359-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:12:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:12:47.549-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:12:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:13:17.688-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:13:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:13:47.880-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:13:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:14:18.025-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:14:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:14:48.285-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:14:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:15:18.621-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:15:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:15:48.798-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:15:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:16:19.079-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:16:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:16:49.361-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:16:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:17:19.646-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:17:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:17:49.925-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:17:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:18:20.112-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:18:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:18:50.347-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:18:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:19:20.500-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:19:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:19:50.649-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:19:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:20:20.926-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:20:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:20:51.205-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:20:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:21:21.497-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:21:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:21:51.828-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:21:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:22:22.096-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:22:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:22:52.371-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:22:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:23:22.629-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:23:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:23:52.934-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:23:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:24:23.218-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:24:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:24:53.488-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:24:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:25:23.809-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:25:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:25:54.088-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:25:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:26:24.335-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:26:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:26:54.645-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:26:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:27:24.920-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:27:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:27:55.256-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:27:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:28:25.500-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:28:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:28:55.790-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:28:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:29:26.064-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:29:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:29:56.265-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:29:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:30:26.528-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:30:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:30:56.808-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:30:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:31:27.064-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:31:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:31:57.351-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:31:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:32:27.654-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:32:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:32:57.824-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:32:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:33:28.097-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:33:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:33:58.241-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:33:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:34:28.393-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:34:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:34:58.671-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:34:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:35:28.971-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:35:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:35:59.317-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:35:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:36:29.622-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:36:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:36:59.923-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:36:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:37:30.166-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:37:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:38:00.475-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:38:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:38:30.768-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:38:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:39:01.052-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:39:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:39:31.302-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:39:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:40:01.579-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:40:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:40:31.873-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:40:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:41:02.146-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:41:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:41:32.430-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:41:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:42:02.728-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:42:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:42:32.949-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:42:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:43:03.138-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:43:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:43:33.426-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:43:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:44:03.610-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:44:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:44:33.889-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:44:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:45:04.233-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:45:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:45:34.536-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:45:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:46:04.795-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:46:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:46:35.126-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:46:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:47:05.283-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:47:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:47:35.621-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:47:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:48:05.818-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:48:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:48:36.135-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:48:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:49:06.375-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:49:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:49:36.531-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:49:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:50:06.810-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:50:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:50:37.049-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:50:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:51:07.324-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:51:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:51:37.630-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:51:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:52:07.991-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:52:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:52:38.242-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:52:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:53:08.393-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:53:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:53:38.670-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:53:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:54:08.874-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:54:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:54:39.012-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:54:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:55:09.294-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:55:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:55:39.606-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:55:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:56:09.764-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:56:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:56:40.012-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:56:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:57:10.317-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:57:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:57:40.632-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:57:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:58:10.915-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:58:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:58:41.188-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:58:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:59:12.137-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:59:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T18:59:42.357-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 18:59:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:00:12.621-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:00:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:00:42.913-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:00:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:01:13.164-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:01:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:01:43.548-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:01:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:02:13.776-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:02:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:02:43.911-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:02:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:03:14.190-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:03:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:03:44.331-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:03:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:04:14.642-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:04:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:04:45.008-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:04:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:05:15.312-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:05:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:05:45.606-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:05:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:06:15.789-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:06:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:06:46.055-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:06:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:07:16.321-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:07:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:07:46.618-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:07:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:08:16.901-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:08:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:08:47.203-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:08:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:09:17.451-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:09:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:09:47.799-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:09:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:10:18.077-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:10:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:10:48.242-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:10:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:11:18.518-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:11:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:11:48.810-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:11:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:12:18.990-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:12:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:12:49.275-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:12:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:13:19.544-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:13:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:13:49.806-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:13:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:14:20.087-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:14:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:14:50.558-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:14:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:15:20.787-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:15:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:15:51.163-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:15:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:16:21.306-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:16:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:16:51.578-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:16:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:17:22.006-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:17:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:17:52.267-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:17:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:18:22.542-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:18:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:18:52.813-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:18:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:19:22.970-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:19:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:19:53.254-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:19:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:20:23.542-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:20:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:20:53.784-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:20:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:21:23.947-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:21:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:21:54.207-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:21:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:22:24.479-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:22:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:22:54.736-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:22:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:23:25.027-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:23:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:23:55.305-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:23:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:24:25.570-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:24:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:24:55.745-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:24:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:25:25.910-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:25:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:25:56.173-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:25:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:26:26.367-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:26:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:26:56.665-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:26:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:27:26.956-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:27:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:27:57.145-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:27:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:28:27.412-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:28:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:28:57.550-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:28:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:29:27.825-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:29:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:29:58.017-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:29:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:30:28.275-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:30:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:30:58.541-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:30:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:31:28.898-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:31:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:31:59.251-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:31:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:32:29.531-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:32:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:32:59.822-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:32:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:33:30.081-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:33:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:34:00.368-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:34:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:34:30.646-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:34:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:35:00.931-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:35:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:35:31.113-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:35:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:36:01.288-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:36:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:36:31.469-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:36:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:37:01.737-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:37:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:37:32.008-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:37:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:38:02.303-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:38:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:38:32.589-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:38:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:39:02.886-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:39:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:39:33.150-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:39:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:40:03.336-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:40:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:40:33.492-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:40:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:41:03.754-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:41:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:41:33.896-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:41:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:42:04.249-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:42:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:42:34.536-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:42:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:43:04.830-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:43:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:43:34.964-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:43:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:44:05.248-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:44:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:44:35.534-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:44:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:45:05.748-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:45:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:45:36.148-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:45:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:46:06.560-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:46:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:46:36.749-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:46:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:47:06.903-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:47:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:47:37.205-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:47:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:48:07.790-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:48:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:48:37.950-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:48:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:49:08.231-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:49:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:49:38.491-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:49:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:50:08.823-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:50:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:50:39.095-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:50:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:51:09.388-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:51:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:51:39.669-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:51:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:52:10.012-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:52:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:52:40.273-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:52:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:53:10.416-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:53:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:53:40.703-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:53:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:54:11.003-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:54:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:54:41.178-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:54:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:55:11.588-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:55:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:55:41.842-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:55:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:56:12.090-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:56:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:56:42.238-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:56:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:57:12.499-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:57:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:57:42.811-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:57:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:58:12.960-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:58:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:58:43.295-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:58:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:59:13.446-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:59:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T19:59:43.772-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 19:59:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:00:14.136-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:00:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:00:44.419-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:00:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:01:14.734-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:01:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:01:44.955-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:01:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:02:15.221-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:02:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:02:45.368-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:02:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:03:15.659-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:03:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:03:45.875-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:03:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:04:16.148-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:04:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:04:46.767-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:04:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:05:17.064-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:05:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:05:47.327-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:05:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:06:17.612-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:06:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:06:47.892-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:06:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:07:18.154-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:07:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:07:48.346-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:07:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:08:18.653-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:08:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:08:48.951-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:08:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:09:19.238-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:09:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:09:49.478-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:09:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:10:19.775-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:10:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:10:50.029-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:10:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:11:20.377-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:11:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:11:50.772-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:11:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:12:20.943-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:12:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:12:51.239-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:12:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:13:21.508-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:13:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:13:51.819-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:13:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:14:22.093-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:14:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:14:52.487-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:14:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:15:22.827-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:15:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:15:52.968-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:15:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:16:23.454-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:16:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:16:53.896-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:16:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:17:24.176-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:17:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:17:54.358-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:17:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:18:24.564-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:18:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:18:54.875-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:18:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:19:25.043-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:19:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:19:55.240-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:19:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:20:25.637-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:20:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:20:55.903-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:20:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:21:26.376-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:21:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:21:56.631-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:21:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:22:26.924-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:22:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:22:57.197-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:22:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:23:27.478-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:23:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:23:57.746-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:23:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:24:27.913-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:24:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:24:58.105-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:24:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:25:28.409-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:25:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:25:58.792-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:25:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:26:29.057-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:26:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:26:59.341-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:26:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:27:29.610-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:27:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:27:59.899-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:27:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:28:30.189-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:28:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:29:00.348-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:29:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:29:30.623-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:29:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:30:00.946-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:30:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:30:31.202-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:30:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:31:01.334-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:31:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:31:31.503-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:31:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:32:01.669-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:32:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:32:31.941-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:32:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:33:02.271-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:33:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:33:32.643-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:33:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:34:02.803-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:34:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:34:33.075-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:34:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:35:03.353-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:35:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:35:33.742-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:35:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:36:03.999-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:36:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:36:34.255-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:36:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:37:04.415-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:37:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:37:34.600-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:37:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:38:04.887-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:38:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:38:35.126-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:38:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:39:05.500-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:39:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:39:35.763-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:39:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:40:06.039-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:40:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:40:36.369-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:40:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:41:06.647-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:41:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:41:36.835-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:41:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:42:07.209-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:42:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:42:37.375-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:42:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:43:07.671-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:43:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:43:37.828-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:43:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:44:08.099-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:44:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:44:38.402-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:44:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:45:08.681-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:45:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:45:38.973-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:45:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:46:09.169-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:46:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:46:39.446-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:46:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:47:09.710-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:47:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:47:39.986-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:47:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:48:10.358-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:48:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:48:40.625-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:48:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:49:11.183-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:49:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:49:41.598-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:49:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:50:11.964-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:50:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:50:42.250-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:50:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:51:12.539-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:51:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:51:42.777-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:51:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:52:13.070-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:52:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:52:43.417-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:52:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:53:13.702-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:53:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:53:43.974-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:53:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:54:14.270-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:54:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:54:44.549-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:54:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:55:14.818-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:55:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:55:45.107-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:55:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:56:15.543-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:56:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:56:45.748-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:56:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:57:16.018-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:57:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:57:46.296-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:57:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:58:16.551-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:58:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:58:46.881-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:58:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:59:17.180-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:59:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T20:59:47.455-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 20:59:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:00:17.891-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:00:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:00:48.155-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:00:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:01:18.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:01:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:01:48.639-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:01:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:02:18.966-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:02:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:02:49.255-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:02:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:03:19.546-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:03:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:03:49.911-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:03:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:04:20.251-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:04:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:04:50.792-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:04:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:05:21.095-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:05:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:05:51.266-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:05:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:06:21.489-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:06:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:06:51.737-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:06:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:07:22.000-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:07:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:07:52.286-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:07:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:08:22.558-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:08:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:08:52.843-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:08:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:09:23.142-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:09:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:09:53.321-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:09:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:10:23.726-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:10:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:10:54.003-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:10:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:11:24.272-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:11:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:11:54.571-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:11:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:12:24.843-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:12:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:12:55.077-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:12:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:13:25.371-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:13:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:13:55.652-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:13:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:14:25.957-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:14:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:14:56.261-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:14:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:15:26.549-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:15:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:15:56.904-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:15:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:16:27.230-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:16:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:16:57.461-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:16:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:17:27.768-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:17:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:17:57.939-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:17:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:18:28.192-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:18:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:18:58.432-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:18:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:19:28.793-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:19:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:19:59.137-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:19:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:20:29.427-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:20:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:20:59.727-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:20:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:21:29.973-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:21:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:22:00.262-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:21:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:22:30.449-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:22:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:23:00.599-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:23:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:23:30.865-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:23:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:24:01.004-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:24:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:24:31.333-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:24:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:25:01.643-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:25:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:25:31.830-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:25:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:26:02.171-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:26:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:26:08.248-0500 [conn8] authenticate db: historyDb { authenticate: 1, user: "its_rw", nonce: "xxx", key: "xxx" } 2017-01-24T21:26:08.264-0500 [conn9] authenticate db: historyDb { authenticate: 1, user: "its_rw", nonce: "xxx", key: "xxx" } 2017-01-24T21:26:32.394-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:26:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:27:02.681-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:27:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:27:32.957-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:27:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:28:03.255-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:28:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:28:33.529-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:28:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:29:03.813-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:29:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:29:34.039-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:29:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:30:04.237-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:30:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:30:34.500-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:30:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:31:04.653-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:31:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:31:34.944-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:31:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:32:05.153-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:32:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:32:35.432-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:32:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:33:05.815-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:33:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:33:36.097-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:33:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:34:06.270-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:34:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:34:36.498-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:34:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:35:06.745-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:35:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:35:36.898-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:35:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:36:07.091-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:36:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:36:37.235-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:36:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:37:07.514-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:37:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:37:37.983-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:37:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:38:08.266-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:38:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:38:38.539-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:38:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:39:08.771-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:39:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:39:38.919-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:39:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:40:09.287-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:40:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:40:39.610-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:40:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:41:09.873-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:41:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:41:40.168-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:41:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:42:10.438-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:42:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:42:40.730-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:42:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:43:11.048-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:43:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:43:41.369-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:43:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:44:11.756-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:44:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:44:42.052-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:44:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:45:12.428-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:45:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:45:42.608-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:45:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:46:12.922-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:46:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:46:43.237-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:46:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:47:13.509-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:47:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:47:43.780-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:47:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:48:14.048-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:48:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:48:44.413-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:48:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:49:14.675-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:49:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:49:44.944-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:49:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:50:15.212-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:50:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:50:45.509-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:50:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:51:15.712-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:51:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:51:46.016-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:51:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:52:16.210-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:52:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:52:46.510-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:52:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:53:16.883-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:53:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:53:47.138-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:53:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:54:17.404-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:54:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:54:47.677-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:54:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:55:17.885-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:55:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:55:48.183-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:55:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:56:18.487-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:56:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:56:48.951-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:56:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:57:19.132-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:57:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:57:49.324-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:57:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:58:19.593-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:58:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:58:49.865-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:58:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:59:20.230-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:59:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T21:59:50.498-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 21:59:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:00:20.789-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:00:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:00:50.971-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:00:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:01:21.305-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:01:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:01:51.641-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:01:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:02:21.920-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:02:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:02:52.272-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:02:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:03:22.611-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:03:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:03:52.913-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:03:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:04:23.365-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:04:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:04:53.637-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:04:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:05:23.816-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:05:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:05:54.144-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:05:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:06:24.483-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:06:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:06:54.666-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:06:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:07:24.966-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:07:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:07:55.246-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:07:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:08:25.551-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:08:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:08:55.751-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:08:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:09:26.014-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:09:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:09:56.277-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:09:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:10:26.560-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:10:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:10:56.838-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:10:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:11:27.259-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:11:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:11:57.572-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:11:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:12:27.806-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:12:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:12:58.125-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:12:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:13:28.428-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:13:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:13:58.602-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:13:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:14:28.955-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:14:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:14:59.204-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:14:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:15:29.495-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:15:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:15:59.767-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:15:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:16:30.018-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:16:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:17:00.345-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:17:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:17:30.607-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:17:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:18:00.801-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:18:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:18:31.097-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:18:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:19:01.388-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:19:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:19:31.686-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:19:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:20:01.988-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:20:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:20:32.243-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:20:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:21:02.617-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:21:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:21:32.923-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:21:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:22:03.163-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:22:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:22:33.357-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:22:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:23:03.624-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:23:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:23:33.859-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:23:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:24:04.112-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:24:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:24:34.323-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:24:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:25:04.472-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:25:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:25:34.724-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:25:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:26:04.866-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:26:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:26:35.146-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:26:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:27:05.426-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:27:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:27:35.753-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:27:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:28:05.898-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:28:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:28:36.171-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:28:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:29:06.462-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:29:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:29:36.787-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:29:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:30:07.075-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:30:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:30:37.361-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:30:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:31:07.528-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:31:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:31:37.821-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:31:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:32:07.999-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:32:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:32:38.323-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:32:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:33:08.589-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:33:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:33:38.939-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:33:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:34:09.149-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:34:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:34:39.408-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:34:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:35:09.607-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:35:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:35:39.894-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:35:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:36:10.262-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:36:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:36:40.550-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:36:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:37:10.707-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:37:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:37:40.988-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:37:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:38:11.253-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:38:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:38:41.523-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:38:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:39:11.793-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:39:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:39:41.996-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:39:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:40:12.390-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:40:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:40:42.719-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:40:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:41:12.967-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:41:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:41:43.390-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:41:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:42:13.661-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:42:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:42:43.952-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:42:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:43:14.118-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:43:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:43:44.578-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:43:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:44:14.711-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:44:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:44:44.995-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:44:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:45:15.168-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:45:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:45:45.445-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:45:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:46:15.598-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:46:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:46:45.780-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:46:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:47:16.034-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:47:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:47:46.188-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:47:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:48:16.450-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:48:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:48:46.720-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:48:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:49:17.180-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:49:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:49:47.377-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:49:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:50:17.654-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:50:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:50:47.933-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:50:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:51:18.189-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:51:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:51:48.348-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:51:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:52:18.734-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:52:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:52:49.139-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:52:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:53:19.424-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:53:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:53:49.863-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:53:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:54:20.039-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:54:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:54:50.338-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:54:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:55:20.517-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:55:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:55:50.796-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:55:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:56:21.092-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:56:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:56:51.355-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:56:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:57:21.523-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:57:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:57:51.778-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:57:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:58:22.059-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:58:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:58:52.338-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:58:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:59:22.533-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:59:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T22:59:52.807-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 22:59:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:00:22.947-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:00:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:00:53.148-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:00:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:01:23.427-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:01:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:01:53.798-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:01:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:02:24.079-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:02:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:02:54.350-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:02:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:03:24.758-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:03:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:03:55.045-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:03:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:04:25.334-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:04:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:04:55.611-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:04:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:05:25.921-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:05:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:05:56.197-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:05:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:06:26.462-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:06:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:06:56.739-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:06:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:07:27.059-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:07:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:07:57.361-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:07:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:08:27.521-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:08:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:08:57.836-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:08:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:09:28.098-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:09:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:09:58.454-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:09:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:10:28.837-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:10:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:10:59.019-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:10:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:11:29.238-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:11:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:11:59.392-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:11:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:12:29.683-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:12:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:12:59.980-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:12:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:13:30.279-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:13:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:14:00.576-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:14:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:14:30.939-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:14:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:15:01.194-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:15:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:15:31.330-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:15:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:16:01.626-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:16:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:16:31.873-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:16:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:17:02.218-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:17:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:17:32.504-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:17:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:18:02.859-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:18:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:18:33.191-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:18:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:19:03.484-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:19:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:19:33.832-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:19:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:20:04.090-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:20:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:20:34.375-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:20:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:21:04.588-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:21:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:21:34.903-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:21:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:22:05.127-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:22:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:22:35.436-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:22:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:23:05.780-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:23:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:23:36.202-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:23:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:24:06.489-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:24:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:24:36.756-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:24:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:25:07.036-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:25:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:25:37.319-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:25:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:26:07.681-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:26:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:26:38.004-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:26:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:27:08.289-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:27:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:27:38.609-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:27:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:28:08.919-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:28:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:28:39.102-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:28:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:29:09.384-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:29:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:29:39.639-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:29:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:30:10.016-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:30:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:30:40.324-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:30:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:31:10.591-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:31:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:31:40.953-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:31:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:32:11.243-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:32:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:32:41.451-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:32:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:33:11.728-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:33:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:33:41.882-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:33:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:34:12.168-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:34:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:34:42.454-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:34:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:35:12.760-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:35:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:35:43.010-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:35:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:36:13.343-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:36:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:36:43.508-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:36:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:37:13.843-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:37:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:37:44.103-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:37:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:38:14.348-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:38:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:38:44.619-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:38:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:39:14.925-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:39:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:39:45.193-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:39:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:40:15.487-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:40:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:40:45.761-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:40:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:41:16.177-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:41:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:41:46.448-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:41:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:42:16.747-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:42:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:42:46.987-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:42:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:43:17.143-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:43:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:43:47.312-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:43:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:44:17.443-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:44:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:44:47.783-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:44:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:45:18.126-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:45:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:45:48.406-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:45:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:46:18.667-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:46:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:46:48.921-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:46:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:47:19.261-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:47:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:47:49.536-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:47:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:48:19.780-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:48:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:48:50.087-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:48:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:49:20.380-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:49:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:49:50.678-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:49:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:50:20.932-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:50:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:50:51.215-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:50:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:51:21.499-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:51:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:51:51.779-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:51:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:52:22.061-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:52:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:52:52.349-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:52:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:53:22.490-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:53:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:53:52.791-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:53:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:54:23.114-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:54:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:54:53.281-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:54:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:55:23.470-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:55:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:55:53.755-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:55:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:56:23.915-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:56:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:56:54.194-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:56:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:57:24.460-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:57:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:57:54.734-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:57:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:58:24.971-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:58:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:58:55.210-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:58:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:59:25.495-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:59:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-24T23:59:55.802-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 24 23:59:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:00:03.663-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:00:03.664-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:00:25.995-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:00:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:00:34.123-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:00:34.123-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:00:40.345-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:00:40.345-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:00:52.695-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:00:52.695-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:00:56.169-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:00:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:01:17.226-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:01:17.226-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:01:26.542-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:01:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:01:56.692-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:01:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:02:12.111-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:02:12.111-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:02:18.395-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:02:18.395-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:02:27.066-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:02:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:02:55.054-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5888317daa6da0fe8d55a3bd') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485320574863), why: "doing balance round", ts: ObjectId('5888317e9527cdec667c0fea') } } gle1: { lastOp: Timestamp 1485320574000|33, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 34, writtenTo: null, err: null, waited: 34, ok: 1.0 } gle2: { lastOp: Timestamp 1485240946000|43, connectionId: 393608, updatedExisting: false, n: 0, syncMillis: 35, writtenTo: null, err: null, waited: 35, ok: 1.0 } 2017-01-25T00:02:55.063-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-25T00:02:55.275-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5888317e9527cdec667c0fea 2017-01-25T00:02:55.941-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T00:02:57.258-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:02:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:03:08.398-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:03:08.398-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:03:14.827-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588831929527cdec667c0fec 2017-01-25T00:03:15.392-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T00:03:27.570-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:03:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:03:57.859-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:03:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:04:28.130-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:04:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:04:58.326-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:04:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:05:05.038-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:05:05.038-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:05:28.585-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:05:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:05:35.637-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:05:35.637-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:05:41.821-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:05:41.821-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:05:58.856-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:05:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:06:29.182-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:06:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:06:59.467-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:06:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:07:29.608-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:07:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:07:55.523-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:07:55.523-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:07:59.871-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:07:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:08:01.861-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588832b19527cdec667c0ff1 2017-01-25T00:08:02.541-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T00:08:30.149-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:08:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:09:00.297-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:09:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:09:30.691-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:09:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:10:00.945-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:10:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:10:16.247-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:10:16.248-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:10:28.651-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588833449527cdec667c0ff3 2017-01-25T00:10:29.320-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T00:10:31.179-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:10:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:10:35.704-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5888334b9527cdec667c0ff4 2017-01-25T00:10:36.374-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T00:10:54.779-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:10:54.779-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:11:01.441-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:11:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:11:19.325-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:11:19.325-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:11:31.775-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:11:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:11:37.709-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:11:37.709-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:12:01.937-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:12:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:12:02.158-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:12:02.158-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:12:20.535-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:12:20.535-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:12:32.250-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:12:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:13:02.656-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:13:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:13:27.530-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588833f79527cdec667c0ffa 2017-01-25T00:13:28.257-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T00:13:32.956-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:13:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:14:03.238-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:14:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:14:33.506-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:14:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:14:41.540-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588834419527cdec667c0ffb 2017-01-25T00:14:42.146-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T00:14:54.565-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5888344e9527cdec667c0ffc 2017-01-25T00:14:55.279-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T00:15:03.798-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:15:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:15:13.764-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588834619527cdec667c0ffd 2017-01-25T00:15:14.606-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T00:15:27.022-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5888346e9527cdec667c0ffe 2017-01-25T00:15:27.767-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T00:15:34.121-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:15:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:16:04.277-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:16:04.277-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:16:04.310-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:16:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:16:34.569-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:16:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:16:47.035-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:16:47.035-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:17:04.747-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:17:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:17:34.985-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:17:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:17:35.849-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:17:35.849-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:17:54.211-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:17:54.211-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:18:05.306-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:18:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:18:12.614-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:18:12.614-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:18:25.046-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:18:25.046-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:18:35.606-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:18:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:18:49.479-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:18:49.479-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:18:55.676-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:18:55.676-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:19:05.890-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:19:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:19:20.085-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:19:20.085-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:19:32.325-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:19:32.325-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:19:36.071-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:19:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:20:06.345-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:20:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:20:15.087-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:20:15.087-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:20:36.636-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:20:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:21:06.934-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:21:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:21:22.125-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:21:22.125-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:21:37.164-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:21:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:22:07.514-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:22:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:22:37.884-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:22:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:23:08.078-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:23:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:23:23.675-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:23:23.675-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:23:38.392-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:23:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:24:08.701-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:24:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:24:38.955-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:24:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:24:42.839-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:24:42.839-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:24:55.092-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:24:55.092-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:25:09.242-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:25:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:25:25.619-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:25:25.619-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:25:39.583-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:25:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:25:56.174-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:25:56.174-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:26:09.915-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:26:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:26:20.525-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:26:20.525-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:26:26.713-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:26:26.713-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:26:40.081-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:26:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:26:45.110-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:26:45.110-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:27:03.475-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:27:03.475-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:27:10.358-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:27:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:27:21.803-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:27:21.804-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:27:40.288-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5888374c9527cdec667c1015 2017-01-25T00:27:40.637-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:27:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:27:40.968-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T00:27:59.493-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5888375f9527cdec667c1016 2017-01-25T00:28:00.139-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T00:28:10.907-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:28:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:28:41.201-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:28:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:29:01.121-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:29:01.122-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:29:11.484-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:29:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:29:19.472-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:29:19.472-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:29:41.761-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:29:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:30:12.014-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:30:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:30:42.302-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:30:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:31:12.694-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:31:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:31:27.396-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5888382f9527cdec667c1019 2017-01-25T00:31:28.023-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T00:31:34.410-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588838369527cdec667c101a 2017-01-25T00:31:35.117-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T00:31:42.981-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:31:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:31:47.526-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588838439527cdec667c101b 2017-01-25T00:31:48.224-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T00:32:00.688-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588838509527cdec667c101c 2017-01-25T00:32:01.396-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T00:32:07.641-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588838579527cdec667c101d 2017-01-25T00:32:08.412-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T00:32:13.292-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:32:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:32:20.958-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588838649527cdec667c101e 2017-01-25T00:32:21.555-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T00:32:43.632-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:32:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:32:52.231-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:32:52.231-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:33:13.896-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:33:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:33:16.571-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:33:16.571-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:33:44.158-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:33:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:33:53.194-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588838c19527cdec667c1021 2017-01-25T00:33:53.790-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T00:34:14.465-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:34:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:34:44.747-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:34:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:35:15.054-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:35:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:35:37.365-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588839299527cdec667c1022 2017-01-25T00:35:38.132-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T00:35:45.440-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:35:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:35:56.566-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5888393c9527cdec667c1023 2017-01-25T00:35:57.275-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T00:36:09.524-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:36:09.524-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:36:15.616-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:36:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:36:15.727-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5888394f9527cdec667c1025 2017-01-25T00:36:16.503-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T00:36:45.819-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:36:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:36:53.046-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('58883974113d81d9a53b4e0e') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485322612948), why: "doing balance round", ts: ObjectId('588839749527cdec667c1026') } } gle1: { lastOp: Timestamp 1485322613000|2, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 5, writtenTo: null, err: null, waited: 5, ok: 1.0 } gle2: { lastOp: Timestamp 1485322576000|14, connectionId: 393608, updatedExisting: false, n: 0, syncMillis: 20, writtenTo: null, err: null, waited: 20, ok: 1.0 } 2017-01-25T00:36:53.055-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-25T00:36:53.156-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588839749527cdec667c1026 2017-01-25T00:36:53.788-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T00:37:00.240-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5888397b9527cdec667c1027 2017-01-25T00:37:00.873-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T00:37:16.217-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:37:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:37:19.445-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5888398f9527cdec667c1028 2017-01-25T00:37:20.075-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T00:37:46.548-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:37:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:38:16.821-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:38:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:38:21.018-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:38:21.018-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:38:47.173-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:38:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:39:17.532-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:39:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:39:47.808-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:39:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:39:52.672-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:39:52.672-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:40:18.109-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:40:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:40:23.317-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58883a479527cdec667c102b 2017-01-25T00:40:24.050-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T00:40:30.420-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58883a4e9527cdec667c102c 2017-01-25T00:40:31.059-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T00:40:48.343-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:40:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:41:18.530-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:41:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:41:37.983-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:41:37.983-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:41:44.274-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:41:44.274-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:41:48.716-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:41:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:42:08.724-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:42:08.724-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:42:14.940-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:42:14.940-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:42:19.025-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:42:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:42:49.182-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:42:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:43:03.672-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:43:03.672-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:43:19.350-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:43:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:43:49.627-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:43:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:43:52.380-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:43:52.380-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:44:04.593-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:44:04.593-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:44:10.774-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:44:10.775-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:44:20.011-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:44:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:44:50.317-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:44:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:44:53.418-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:44:53.418-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:45:20.610-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:45:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:45:42.140-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:45:42.140-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:45:50.884-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:45:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:46:18.801-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:46:18.801-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:46:21.204-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:46:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:46:37.153-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:46:37.153-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:46:51.522-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:46:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:47:21.819-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:47:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:47:52.135-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:47:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:48:22.510-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:48:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:48:52.700-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:48:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:49:09.030-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:49:09.030-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:49:22.982-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:49:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:49:53.308-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:49:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:50:16.232-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('58883c97506bb6f3d3f4d544') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485323416132), why: "doing balance round", ts: ObjectId('58883c989527cdec667c103a') } } gle1: { lastOp: Timestamp 1485323416000|5, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 11, writtenTo: null, err: null, waited: 11, ok: 1.0 } gle2: { lastOp: Timestamp 1485322831000|2, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 13, writtenTo: null, err: null, waited: 13, ok: 1.0 } 2017-01-25T00:50:16.273-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-25T00:50:16.273-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:50:23.496-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:50:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:50:23.496-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-25T00:50:23.570-0500 [LockPinger] handled late remove of old distributed lock with ts 58883c989527cdec667c103a 2017-01-25T00:50:53.723-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:50:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:51:23.927-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:51:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:51:29.454-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('58883ce0e3904bd49a01e853') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485323489300), why: "doing balance round", ts: ObjectId('58883ce19527cdec667c103b') } } gle1: { lastOp: Timestamp 1485323416000|5, connectionId: 21778, updatedExisting: false, n: 0, syncMillis: 5, writtenTo: null, err: null, waited: 5, ok: 1.0 } gle2: { lastOp: Timestamp 1485323489000|15, connectionId: 6379656, updatedExisting: true, n: 1, syncMillis: 32, writtenTo: null, err: null, waited: 32, ok: 1.0 } 2017-01-25T00:51:29.466-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-25T00:51:29.631-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58883ce19527cdec667c103b 2017-01-25T00:51:30.362-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T00:51:54.228-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:51:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:52:13.266-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58883d0c9527cdec667c103c 2017-01-25T00:52:13.978-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T00:52:24.502-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:52:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:52:54.696-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:52:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:53:24.971-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:53:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:53:51.381-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:53:51.381-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:53:55.279-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:53:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:54:25.567-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:54:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:54:34.007-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('58883d9999af93d783279d9d') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485323673890), why: "doing balance round", ts: ObjectId('58883d999527cdec667c103e') } } gle1: { lastOp: Timestamp 1485323673000|24, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 3, writtenTo: null, err: null, waited: 3, ok: 1.0 } gle2: { lastOp: Timestamp 1485323533000|31, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 14, writtenTo: null, err: null, waited: 14, ok: 1.0 } 2017-01-25T00:54:34.014-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-25T00:54:34.014-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:54:55.835-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:54:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:54:55.835-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-25T00:54:55.973-0500 [LockPinger] handled late remove of old distributed lock with ts 58883d999527cdec667c103e 2017-01-25T00:54:58.423-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:54:58.423-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:55:10.885-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58883dbe9527cdec667c1040 2017-01-25T00:55:11.682-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T00:55:26.199-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:55:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:55:30.236-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58883dd19527cdec667c1041 2017-01-25T00:55:31.042-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T00:55:56.529-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:55:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:56:07.879-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58883df79527cdec667c1042 2017-01-25T00:56:08.515-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T00:56:26.878-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:56:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:56:51.111-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:56:51.111-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:56:57.387-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:56:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:57:27.537-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:57:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:57:39.808-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('58883e526defb0ff1217ec9f') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485323859662), why: "doing balance round", ts: ObjectId('58883e539527cdec667c1044') } } gle1: { lastOp: Timestamp 1485323859000|37, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 8, writtenTo: null, err: null, waited: 8, ok: 1.0 } gle2: { lastOp: Timestamp 1485323768000|22, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 30, writtenTo: null, err: null, waited: 30, ok: 1.0 } 2017-01-25T00:57:39.910-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-25T00:57:39.910-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:57:57.839-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:57:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:57:57.839-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-25T00:57:57.980-0500 [LockPinger] handled late remove of old distributed lock with ts 58883e539527cdec667c1044 2017-01-25T00:58:16.399-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:58:16.399-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:58:28.383-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:58:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:58:35.018-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58883e8a9527cdec667c1046 2017-01-25T00:58:35.723-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T00:58:41.936-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58883e919527cdec667c1047 2017-01-25T00:58:42.609-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T00:58:58.646-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:58:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:59:13.147-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T00:59:13.147-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T00:59:28.923-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:59:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T00:59:59.200-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 00:59:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:00:14.095-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:00:14.095-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:00:29.479-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:00:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:00:59.811-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:00:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:01:30.097-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:01:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:02:00.407-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:02:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:02:30.632-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:02:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:02:58.412-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58883f929527cdec667c104a 2017-01-25T01:02:59.226-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T01:03:00.932-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:03:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:03:23.858-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58883fab9527cdec667c104b 2017-01-25T01:03:24.506-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T01:03:31.196-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:03:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:04:01.438-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:04:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:04:19.381-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:04:19.381-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:04:31.647-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:04:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:04:55.974-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:04:55.974-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:05:01.778-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:05:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:05:08.192-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:05:08.192-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:05:32.075-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:05:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:06:02.235-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:06:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:06:32.523-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:06:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:06:39.789-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5888406f9527cdec667c104f 2017-01-25T01:06:40.455-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T01:07:02.659-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:07:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:07:33.012-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:07:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:08:03.321-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:08:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:08:24.023-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:08:24.023-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:08:33.562-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:08:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:08:36.427-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588840e49527cdec667c1051 2017-01-25T01:08:37.141-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T01:09:03.930-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:09:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:09:34.148-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:09:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:10:04.462-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:10:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:10:34.677-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:10:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:11:03.074-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:11:03.074-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:11:04.893-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:11:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:11:21.650-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588841899527cdec667c1053 2017-01-25T01:11:22.426-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T01:11:35.216-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:11:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:12:05.489-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:12:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:12:35.813-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:12:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:13:05.933-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:13:05.933-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:13:06.145-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:13:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:13:36.311-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:13:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:14:06.604-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:14:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:14:13.111-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588842349527cdec667c1055 2017-01-25T01:14:13.845-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T01:14:32.430-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588842489527cdec667c1056 2017-01-25T01:14:33.137-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T01:14:36.873-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:14:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:14:45.566-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:14:45.566-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:15:04.000-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:15:04.000-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:15:07.220-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:15:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:15:37.474-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:15:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:15:46.628-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:15:46.628-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:16:07.765-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:16:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:16:23.401-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588842b79527cdec667c105a 2017-01-25T01:16:24.148-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T01:16:38.084-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:16:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:16:42.503-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588842ca9527cdec667c105b 2017-01-25T01:16:43.146-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T01:16:55.589-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588842d79527cdec667c105c 2017-01-25T01:16:56.159-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T01:17:08.487-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:17:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:17:14.548-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588842ea9527cdec667c105d 2017-01-25T01:17:15.180-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T01:17:38.763-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:17:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:18:08.934-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:18:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:18:16.134-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:18:16.134-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:18:39.225-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:18:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:19:09.380-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:19:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:19:29.177-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:19:29.177-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:19:39.732-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:19:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:19:59.694-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:19:59.694-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:20:10.025-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:20:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:20:30.255-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:20:30.255-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:20:40.312-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:20:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:21:10.585-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:21:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:21:37.306-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:21:37.307-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:21:40.880-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:21:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:21:49.629-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:21:49.629-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:22:07.959-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:22:07.959-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:22:11.107-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:22:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:22:41.298-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:22:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:23:11.544-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:23:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:23:21.076-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588844589527cdec667c1065 2017-01-25T01:23:21.742-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T01:23:41.903-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:23:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:24:04.473-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:24:04.473-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:24:12.284-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:24:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:24:41.023-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:24:41.023-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:24:42.579-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:24:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:24:59.407-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:24:59.407-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:25:05.632-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588844c07d1747595837eb40') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485325505483), why: "doing balance round", ts: ObjectId('588844c19527cdec667c1069') } } gle1: { lastOp: Timestamp 1485325401000|30, connectionId: 21778, updatedExisting: false, n: 0, syncMillis: 1, writtenTo: null, err: null, waited: 1, ok: 1.0 } gle2: { lastOp: Timestamp 1485325505000|21, connectionId: 6379656, updatedExisting: true, n: 1, syncMillis: 31, writtenTo: null, err: null, waited: 31, ok: 1.0 } 2017-01-25T01:25:05.643-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-25T01:25:05.811-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588844c19527cdec667c1069 2017-01-25T01:25:06.577-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T01:25:12.852-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:25:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:25:25.126-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588844d49527cdec667c106a 2017-01-25T01:25:25.833-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T01:25:43.142-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:25:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:26:13.436-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:26:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:26:26.757-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588845129527cdec667c106b 2017-01-25T01:26:27.429-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T01:26:39.747-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5888451f9527cdec667c106c 2017-01-25T01:26:40.481-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T01:26:43.639-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:26:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:27:11.074-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:27:11.074-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:27:13.971-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:27:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:27:44.369-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:27:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:28:06.097-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588845759527cdec667c106e 2017-01-25T01:28:06.868-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T01:28:14.689-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:28:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:28:45.054-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:28:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:29:13.950-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:29:13.950-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:29:15.419-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:29:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:29:44.373-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:29:44.373-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:29:45.700-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:29:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:30:15.999-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:30:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:30:27.095-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588846029527cdec667c1071 2017-01-25T01:30:27.767-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T01:30:34.125-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588846099527cdec667c1072 2017-01-25T01:30:34.853-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T01:30:46.291-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:30:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:31:16.652-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:31:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:31:46.932-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:31:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:32:17.201-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:32:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:32:18.383-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:32:18.383-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:32:30.760-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5888467e9527cdec667c1074 2017-01-25T01:32:31.505-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T01:32:47.492-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:32:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:32:55.866-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:32:55.866-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:33:17.840-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:33:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:33:48.200-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:33:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:34:02.988-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:34:02.988-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:34:15.262-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588846e647420e2d53cb5bad') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485326055124), why: "doing balance round", ts: ObjectId('588846e79527cdec667c1077') } } gle1: { lastOp: Timestamp 1485326055000|18, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 14, writtenTo: null, err: null, waited: 14, ok: 1.0 } gle2: { lastOp: Timestamp 1485325951000|9, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 21, writtenTo: null, err: null, waited: 21, ok: 1.0 } 2017-01-25T01:34:15.274-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-25T01:34:15.274-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:34:18.486-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:34:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:34:18.486-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-25T01:34:18.594-0500 [LockPinger] handled late remove of old distributed lock with ts 588846e79527cdec667c1077 2017-01-25T01:34:48.917-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:34:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:35:19.226-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:35:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:35:49.358-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:35:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:36:19.628-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:36:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:36:41.373-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:36:41.373-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:36:49.929-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:36:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:36:59.670-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:36:59.670-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:37:20.284-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:37:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:37:48.459-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:37:48.459-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:37:50.545-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:37:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:38:12.842-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:38:12.842-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:38:20.942-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:38:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:38:25.272-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588847e09527cdec667c107c 2017-01-25T01:38:25.941-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T01:38:50.591-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588847fa9527cdec667c107d 2017-01-25T01:38:51.292-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:38:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:38:51.292-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T01:39:21.550-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:39:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:39:22.061-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588848199527cdec667c107e 2017-01-25T01:39:22.777-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T01:39:51.739-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:39:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:40:17.586-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:40:17.586-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:40:22.030-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:40:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:40:23.847-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:40:23.847-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:40:30.057-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:40:30.057-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:40:52.351-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:40:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:41:00.504-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5888487b84f8a2078cd83eb9') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485326460371), why: "doing balance round", ts: ObjectId('5888487c9527cdec667c1082') } } gle1: { lastOp: Timestamp 1485326460000|8, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 15, writtenTo: null, err: null, waited: 15, ok: 1.0 } gle2: { lastOp: Timestamp 1485326362000|56, connectionId: 393608, updatedExisting: false, n: 0, syncMillis: 28, writtenTo: null, err: null, waited: 28, ok: 1.0 } 2017-01-25T01:41:00.513-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-25T01:41:00.647-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5888487c9527cdec667c1082 2017-01-25T01:41:01.305-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T01:41:13.505-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:41:13.505-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:41:22.515-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:41:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:41:37.882-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:41:37.882-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:41:44.047-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588848a7ddfd3f1234a20775') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485326503948), why: "doing balance round", ts: ObjectId('588848a79527cdec667c1085') } } gle1: { lastOp: Timestamp 1485326504000|1, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 1, writtenTo: null, err: null, waited: 1, ok: 1.0 } gle2: { lastOp: Timestamp 1485326461000|10, connectionId: 393608, updatedExisting: false, n: 0, syncMillis: 6, writtenTo: null, err: null, waited: 6, ok: 1.0 } 2017-01-25T01:41:44.065-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-25T01:41:44.198-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588848a79527cdec667c1085 2017-01-25T01:41:45.014-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T01:41:52.811-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:41:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:42:21.666-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:42:21.667-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:42:23.117-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:42:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:42:53.352-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:42:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:43:16.490-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:43:16.490-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:43:23.670-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:43:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:43:28.726-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:43:28.726-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:43:53.239-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:43:53.239-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:43:53.812-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:43:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:44:24.075-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:44:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:44:36.072-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:44:36.072-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:44:54.505-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:44:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:45:12.860-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:45:12.860-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:45:24.796-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:45:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:45:55.088-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:45:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:45:55.597-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:45:55.597-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:46:25.341-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:46:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:46:55.560-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:46:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:46:56.714-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:46:56.714-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:47:25.807-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:47:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:47:27.326-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:47:27.326-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:47:56.129-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:47:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:47:57.867-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:47:57.867-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:48:26.398-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:48:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:48:34.454-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:48:34.454-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:48:46.747-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:48:46.747-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:48:56.716-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:48:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:49:17.322-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:49:17.322-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:49:26.972-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:49:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:49:35.599-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:49:35.599-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:49:57.246-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:49:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:50:12.438-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:50:12.438-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:50:27.420-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:50:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:50:57.717-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:50:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:51:13.313-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('58884ae0cf2a21eac5a7b803') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485327073240), why: "doing balance round", ts: ObjectId('58884ae19527cdec667c1095') } } gle1: { lastOp: Timestamp 1485327073000|13, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 5, writtenTo: null, err: null, waited: 5, ok: 1.0 } gle2: { lastOp: Timestamp 1485326504000|33, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 9, writtenTo: null, err: null, waited: 9, ok: 1.0 } 2017-01-25T01:51:13.325-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-25T01:51:13.427-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58884ae19527cdec667c1095 2017-01-25T01:51:14.172-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T01:51:26.473-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:51:26.473-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:51:28.111-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:51:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:51:58.432-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:51:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:52:09.205-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('58884b187d1747595837eb75') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485327129056), why: "doing balance round", ts: ObjectId('58884b199527cdec667c1097') } } gle1: { lastOp: Timestamp 1485327074000|4, connectionId: 21778, updatedExisting: false, n: 0, syncMillis: 18, writtenTo: null, err: null, waited: 18, ok: 1.0 } gle2: { lastOp: Timestamp 1485327129000|4, connectionId: 6379656, updatedExisting: true, n: 1, syncMillis: 32, writtenTo: null, err: null, waited: 32, ok: 1.0 } 2017-01-25T01:52:09.211-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-25T01:52:09.211-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:52:28.731-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:52:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:52:28.731-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-25T01:52:28.839-0500 [LockPinger] handled late remove of old distributed lock with ts 58884b199527cdec667c1097 2017-01-25T01:52:45.744-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:52:45.744-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:52:59.121-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:52:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:53:29.453-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:53:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:53:59.735-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:53:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:54:05.028-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58884b8c9527cdec667c1099 2017-01-25T01:54:05.767-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T01:54:18.206-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58884b999527cdec667c109a 2017-01-25T01:54:18.880-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T01:54:29.952-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:54:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:55:00.255-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:54:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:55:01.746-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58884bc59527cdec667c109b 2017-01-25T01:55:02.447-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T01:55:08.772-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58884bcc9527cdec667c109c 2017-01-25T01:55:09.472-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T01:55:30.473-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:55:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:56:00.774-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:56:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:56:31.100-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:56:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:57:01.347-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:57:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:57:11.179-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:57:11.179-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:57:31.621-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:57:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:58:01.910-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:58:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:58:18.046-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:58:18.046-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:58:24.197-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-25T01:58:24.197-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-25T01:58:32.209-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:58:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:58:36.607-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58884c9c9527cdec667c10a0 2017-01-25T01:58:37.239-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T01:59:02.490-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:59:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:59:13.980-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58884cc19527cdec667c10a1 2017-01-25T01:59:14.684-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T01:59:27.062-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58884cce9527cdec667c10a2 2017-01-25T01:59:27.796-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T01:59:32.850-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 01:59:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T01:59:52.620-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58884ce89527cdec667c10a3 2017-01-25T01:59:53.291-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-25T02:00:03.194-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:00:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:00:33.507-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:00:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:01:03.783-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:01:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:01:34.125-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:01:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:02:04.512-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:02:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:02:34.687-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:02:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:03:04.966-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:03:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:03:35.237-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:03:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:04:05.517-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:04:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:04:35.733-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:04:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:05:05.907-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:05:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:05:36.099-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:05:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:06:06.373-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:06:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:06:36.728-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:06:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:07:06.908-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:07:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:07:37.195-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:07:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:08:07.433-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:08:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:08:37.640-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:08:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:09:07.902-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:09:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:09:38.195-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:09:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:10:08.489-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:10:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:10:39.025-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:10:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:11:09.335-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:11:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:11:39.637-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:11:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:12:09.975-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:12:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:12:40.227-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:12:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:13:10.490-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:13:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:13:40.801-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:13:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:14:11.084-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:14:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:14:41.419-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:14:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:15:11.675-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:15:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:15:41.995-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:15:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:16:12.268-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:16:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:16:42.577-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:16:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:17:12.783-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:17:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:17:43.152-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:17:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:18:13.416-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:18:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:18:43.705-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:18:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:19:13.985-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:19:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:19:44.256-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:19:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:20:14.516-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:20:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:20:44.803-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:20:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:21:15.094-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:21:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:21:45.344-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:21:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:22:15.512-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:22:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:22:45.719-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:22:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:23:16.047-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:23:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:23:46.260-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:23:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:24:16.532-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:24:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:24:46.876-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:24:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:25:17.029-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:25:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:25:47.468-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:25:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:26:17.659-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:26:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:26:47.926-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:26:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:27:18.348-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:27:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:27:48.633-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:27:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:28:19.006-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:28:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:28:49.291-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:28:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:29:19.446-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:29:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:29:49.728-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:29:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:30:19.946-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:30:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:30:50.235-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:30:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:31:20.506-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:31:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:31:50.781-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:31:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:32:21.064-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:32:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:32:51.226-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:32:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:33:21.418-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:33:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:33:51.717-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:33:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:34:21.912-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:34:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:34:52.213-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:34:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:35:22.470-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:35:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:35:52.743-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:35:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:36:23.020-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:36:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:36:53.305-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:36:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:37:23.502-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:37:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:37:53.948-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:37:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:38:24.296-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:38:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:38:54.556-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:38:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:39:24.914-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:39:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:39:55.184-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:39:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:40:25.446-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:40:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:40:55.714-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:40:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:41:25.993-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:41:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:41:56.312-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:41:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:42:26.517-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:42:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:42:56.786-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:42:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:43:27.064-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:43:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:43:57.333-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:43:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:44:27.747-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:44:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:44:58.038-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:44:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:45:28.324-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:45:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:45:58.551-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:45:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:46:28.808-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:46:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:46:59.089-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:46:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:47:29.366-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:47:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:47:59.647-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:47:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:48:29.968-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:48:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:49:00.261-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:48:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:49:30.451-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:49:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:50:00.716-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:50:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:50:30.998-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:50:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:51:01.272-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:51:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:51:31.555-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:51:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:52:01.972-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:52:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:52:32.240-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:52:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:53:02.380-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:53:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:53:32.665-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:53:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:54:03.055-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:54:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:54:33.335-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:54:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:55:03.615-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:55:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:55:33.819-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:55:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:56:04.126-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:56:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:56:34.511-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:56:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:57:04.801-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:57:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:57:35.069-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:57:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:58:05.367-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:58:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:58:35.686-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:58:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:59:05.957-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:59:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T02:59:36.527-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 02:59:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:00:06.886-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:00:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:00:37.029-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:00:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:01:07.459-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:01:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:01:37.751-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:01:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:02:08.003-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:02:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:02:38.217-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:02:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:03:08.567-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:03:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:03:38.831-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:03:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:04:09.073-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:04:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:04:39.461-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:04:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:05:09.803-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:05:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:05:40.150-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:05:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:06:10.432-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:06:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:06:40.711-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:06:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:07:11.046-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:07:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:07:41.265-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:07:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:08:11.601-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:08:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:08:42.069-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:08:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:09:12.351-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:09:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:09:42.631-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:09:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:10:12.901-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:10:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:10:43.077-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:10:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:11:13.425-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:11:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:11:43.693-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:11:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:12:13.956-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:12:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:12:44.226-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:12:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:13:14.518-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:13:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:13:44.912-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:13:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:14:15.151-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:14:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:14:45.416-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:14:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:15:15.713-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:15:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:15:45.874-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:15:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:16:16.168-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:16:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:16:46.465-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:16:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:17:16.685-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:17:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:17:47.048-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:17:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:18:17.306-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:18:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:18:47.582-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:18:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:19:18.083-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:19:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:19:48.358-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:19:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:20:18.651-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:20:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:20:48.914-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:20:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:21:19.210-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:21:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:21:49.514-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:21:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:22:19.810-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:22:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:22:50.078-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:22:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:23:20.326-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:23:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:23:50.609-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:23:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:24:20.880-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:24:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:24:51.180-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:24:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:25:21.467-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:25:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:25:51.724-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:25:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:26:22.014-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:26:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:26:52.292-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:26:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:27:22.570-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:27:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:27:52.761-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:27:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:28:23.173-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:28:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:28:53.347-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:28:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:29:23.611-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:29:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:29:53.897-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:29:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:30:24.194-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:30:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:30:54.570-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:30:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:31:24.868-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:31:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:31:55.178-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:31:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:32:25.527-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:32:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:32:55.740-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:32:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:33:25.998-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:33:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:33:56.252-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:33:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:34:26.523-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:34:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:34:56.868-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:34:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:35:27.209-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:35:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:35:57.504-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:35:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:36:27.809-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:36:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:36:57.990-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:36:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:37:28.227-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:37:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:37:58.512-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:37:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:38:28.794-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:38:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:38:59.149-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:38:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:39:29.429-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:39:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:39:59.637-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:39:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:40:29.847-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:40:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:41:00.077-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:40:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:41:30.338-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:41:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:42:00.823-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:42:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:42:30.964-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:42:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:43:01.348-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:43:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:43:31.636-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:43:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:44:01.811-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:44:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:44:32.157-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:44:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:45:02.406-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:45:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:45:32.600-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:45:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:46:02.866-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:46:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:46:33.179-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:46:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:47:03.459-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:47:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:47:33.742-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:47:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:48:04.028-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:48:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:48:34.362-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:48:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:49:04.638-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:49:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:49:34.859-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:49:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:50:05.012-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:50:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:50:35.283-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:50:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:51:05.674-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:51:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:51:35.911-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:51:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:52:06.214-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:52:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:52:36.513-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:52:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:53:06.768-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:53:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:53:37.039-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:53:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:54:07.228-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:54:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:54:37.516-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:54:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:55:07.790-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:55:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:55:38.078-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:55:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:56:08.471-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:56:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:56:38.760-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:56:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:57:09.053-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:57:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:57:39.227-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:57:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:58:09.507-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:58:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:58:39.881-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:58:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:59:10.201-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:59:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T03:59:40.545-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 03:59:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:00:10.678-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:00:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:00:40.957-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:00:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:01:11.321-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:01:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:01:41.475-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:01:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:02:11.883-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:02:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:02:42.143-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:02:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:03:12.283-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:03:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:03:42.574-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:03:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:04:12.858-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:04:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:04:43.162-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:04:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:05:13.325-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:05:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:05:43.594-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:05:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:06:13.849-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:06:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:06:44.143-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:06:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:07:14.447-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:07:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:07:44.675-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:07:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:08:14.931-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:08:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:08:45.218-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:08:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:09:15.512-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:09:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:09:45.784-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:09:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:10:15.990-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:10:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:10:46.131-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:10:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:11:16.429-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:11:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:11:46.829-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:11:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:12:16.976-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:12:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:12:47.256-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:12:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:13:17.520-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:13:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:13:47.881-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:13:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:14:18.180-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:14:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:14:48.433-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:14:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:15:18.650-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:15:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:15:48.986-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:15:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:16:19.251-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:16:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:16:49.552-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:16:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:17:19.737-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:17:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:17:49.915-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:17:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:18:20.198-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:18:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:18:50.487-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:18:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:19:20.777-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:19:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:19:50.929-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:19:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:20:21.216-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:20:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:20:51.505-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:20:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:21:21.760-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:21:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:21:51.910-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:21:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:22:22.146-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:22:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:22:52.428-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:22:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:23:22.657-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:23:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:23:52.897-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:23:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:24:23.170-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:24:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:24:53.648-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:24:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:25:23.926-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:25:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:25:54.200-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:25:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:26:24.403-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:26:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:26:54.726-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:26:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:27:25.008-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:27:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:27:55.316-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:27:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:28:25.545-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:28:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:28:55.902-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:28:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:29:26.171-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:29:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:29:56.557-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:29:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:30:26.756-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:30:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:30:57.088-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:30:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:31:27.355-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:31:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:31:57.556-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:31:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:32:27.838-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:32:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:32:58.327-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:32:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:33:28.582-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:33:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:33:58.864-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:33:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:34:29.177-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:34:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:34:59.489-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:34:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:35:29.771-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:35:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:36:00.024-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:35:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:36:30.195-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:36:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:37:00.459-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:37:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:37:30.808-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:37:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:38:01.095-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:38:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:38:31.400-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:38:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:39:01.678-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:39:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:39:32.062-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:39:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:40:02.300-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:40:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:40:32.510-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:40:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:41:02.868-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:41:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:41:33.162-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:41:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:42:03.470-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:42:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:42:33.829-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:42:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:43:04.163-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:43:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:43:34.549-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:43:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:44:04.781-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:44:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:44:35.057-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:44:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:45:05.359-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:45:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:45:35.719-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:45:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:46:06.015-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:46:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:46:36.297-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:46:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:47:06.636-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:47:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:47:36.971-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:47:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:48:07.250-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:48:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:48:37.447-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:48:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:49:07.601-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:49:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:49:37.838-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:49:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:50:08.150-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:50:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:50:38.492-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:50:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:51:08.767-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:51:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:51:39.038-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:51:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:52:09.377-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:52:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:52:39.702-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:52:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:53:10.079-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:53:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:53:40.500-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:53:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:54:10.818-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:54:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:54:41.141-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:54:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:55:11.418-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:55:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:55:41.682-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:55:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:56:12.118-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:56:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:56:42.392-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:56:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:57:12.523-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:57:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:57:42.802-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:57:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:58:13.072-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:58:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:58:43.248-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:58:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:59:13.476-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:59:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T04:59:43.831-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 04:59:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:00:14.104-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:00:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:00:44.439-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:00:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:01:14.713-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:01:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:01:44.986-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:01:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:02:15.434-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:02:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:02:45.738-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:02:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:03:15.922-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:03:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:03:46.232-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:03:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:04:16.384-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:04:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:04:46.660-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:04:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:05:16.798-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:05:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:05:47.070-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:05:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:06:17.226-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:06:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:06:47.566-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:06:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:07:17.835-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:07:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:07:48.120-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:07:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:08:18.374-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:08:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:08:48.660-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:08:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:09:18.964-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:09:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:09:49.230-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:09:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:10:19.503-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:10:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:10:49.794-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:10:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:11:20.117-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:11:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:11:50.395-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:11:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:12:20.670-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:12:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:12:50.812-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:12:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:13:21.104-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:13:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:13:51.264-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:13:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:14:21.591-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:14:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:14:51.864-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:14:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:15:22.133-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:15:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:15:52.293-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:15:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:16:22.571-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:16:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:16:52.920-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:16:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:17:23.097-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:17:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:17:53.483-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:17:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:18:23.642-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:18:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:18:53.930-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:18:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:19:24.260-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:19:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:19:54.697-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:19:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:20:24.891-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:20:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:20:55.207-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:20:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:21:25.512-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:21:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:21:55.785-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:21:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:22:26.128-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:22:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:22:56.412-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:22:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:23:26.706-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:23:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:23:57.043-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:23:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:24:27.370-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:24:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:24:57.685-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:24:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:25:28.120-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:25:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:25:58.376-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:25:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:26:28.870-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:26:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:26:59.163-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:26:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:27:29.445-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:27:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:27:59.639-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:27:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:28:29.929-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:28:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:29:00.233-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:28:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:29:30.518-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:29:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:30:00.781-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:30:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:30:31.163-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:30:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:31:01.450-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:31:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:31:31.848-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:31:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:32:02.083-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:32:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:32:32.362-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:32:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:33:02.546-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:33:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:33:32.839-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:33:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:34:03.106-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:34:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:34:33.395-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:34:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:35:03.546-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:35:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:35:33.815-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:35:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:36:04.082-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:36:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:36:34.332-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:36:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:37:04.705-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:37:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:37:34.947-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:37:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:38:05.222-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:38:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:38:35.429-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:38:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:39:05.575-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:39:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:39:35.906-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:39:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:40:06.207-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:40:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:40:36.531-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:40:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:41:06.820-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:41:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:41:36.992-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:41:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:42:07.271-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:42:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:42:37.546-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:42:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:43:07.730-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:43:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:43:37.930-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:43:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:44:08.229-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:44:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:44:38.490-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:44:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:45:08.788-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:45:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:45:39.117-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:45:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:46:09.266-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:46:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:46:39.582-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:46:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:47:09.847-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:47:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:47:40.119-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:47:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:48:10.397-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:48:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:48:40.693-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:48:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:49:11.003-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:49:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:49:41.339-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:49:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:50:11.507-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:50:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:50:41.828-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:50:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:51:12.119-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:51:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:51:42.392-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:51:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:52:12.781-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:52:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:52:43.112-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:52:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:53:13.387-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:53:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:53:43.642-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:53:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:54:14.044-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:54:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:54:44.357-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:54:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:55:14.622-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:55:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:55:44.896-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:55:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:56:15.177-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:56:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:56:45.395-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:56:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:57:15.680-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:57:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:57:45.981-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:57:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:58:16.227-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:58:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:58:46.556-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:58:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:59:16.810-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:59:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T05:59:47.205-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 05:59:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:00:17.570-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:00:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:00:47.900-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:00:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:01:18.226-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:01:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:01:48.493-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:01:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:02:18.744-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:02:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:02:48.895-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:02:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:03:19.229-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:03:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:03:49.559-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:03:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:04:19.791-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:04:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:04:49.960-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:04:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:05:20.258-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:05:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:05:50.553-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:05:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:06:20.857-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:06:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:06:51.106-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:06:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:07:21.387-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:07:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:07:51.682-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:07:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:08:21.932-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:08:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:08:52.112-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:08:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:09:22.337-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:09:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:09:52.581-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:09:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:10:22.873-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:10:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:10:53.183-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:10:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:11:23.401-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:11:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:11:53.655-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:11:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:12:24.051-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:12:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:12:54.354-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:12:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:13:24.529-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:13:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:13:54.812-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:13:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:14:25.082-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:14:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:14:55.332-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:14:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:15:25.668-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:15:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:15:55.956-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:15:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:16:26.219-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:16:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:16:56.512-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:16:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:17:26.803-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:17:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:17:57.093-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:17:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:18:27.386-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:18:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:18:57.696-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:18:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:19:27.969-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:19:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:19:58.175-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:19:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:20:28.506-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:20:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:20:58.838-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:20:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:21:29.134-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:21:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:21:59.497-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:21:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:22:29.830-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:22:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:23:00.047-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:22:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:23:30.250-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:23:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:24:00.569-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:24:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:24:30.851-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:24:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:25:01.048-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:25:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:25:31.216-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:25:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:26:01.463-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:26:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:26:31.734-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:26:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:27:01.899-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:27:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:27:32.202-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:27:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:28:02.604-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:28:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:28:32.844-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:28:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:29:03.127-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:29:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:29:33.321-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:29:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:30:03.645-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:30:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:30:33.919-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:30:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:31:04.159-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:31:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:31:34.453-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:31:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:32:04.774-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:32:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:32:35.104-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:32:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:33:05.423-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:33:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:33:35.696-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:33:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:34:05.936-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:34:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:34:36.117-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:34:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:35:06.358-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:35:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:35:36.644-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:35:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:36:06.775-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:36:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:36:37.004-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:36:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:37:07.310-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:37:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:37:37.631-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:37:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:38:07.916-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:38:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:38:38.199-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:38:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:39:08.653-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:39:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:39:38.909-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:39:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:40:09.176-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:40:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:40:39.429-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:40:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:41:09.673-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:41:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:41:39.944-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:41:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:42:10.220-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:42:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:42:40.520-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:42:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:43:10.945-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:43:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:43:41.235-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:43:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:44:11.634-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:44:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:44:41.881-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:44:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:45:12.211-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:45:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:45:42.504-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:45:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:46:12.813-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:46:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:46:43.049-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:46:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:47:13.312-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:47:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:47:43.587-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:47:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:48:13.876-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:48:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:48:44.154-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:48:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:49:14.495-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:49:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:49:44.642-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:49:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:50:14.897-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:50:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:50:45.190-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:50:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:51:15.432-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:51:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:51:45.710-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:51:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:52:15.966-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:52:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:52:46.240-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:52:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:53:16.623-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:53:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:53:46.845-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:53:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:54:17.052-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:54:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:54:47.338-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:54:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:55:17.563-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:55:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:55:47.963-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:55:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:56:18.295-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:56:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:56:48.494-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:56:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:57:18.752-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:57:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:57:49.034-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:57:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:58:19.326-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:58:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:58:49.621-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:58:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:59:19.766-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:59:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T06:59:50.040-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 06:59:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:00:20.335-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:00:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:00:50.621-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:00:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:01:20.917-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:01:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:01:51.232-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:01:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:02:21.532-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:02:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:02:51.872-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:02:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:03:22.201-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:03:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:03:52.412-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:03:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:04:22.674-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:04:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:04:52.950-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:04:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:05:23.136-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:05:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:05:53.397-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:05:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:06:23.698-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:06:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:06:54.131-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:06:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:07:24.387-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:07:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:07:54.654-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:07:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:08:24.814-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:08:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:08:55.010-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:08:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:09:25.270-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:09:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:09:55.702-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:09:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:10:25.947-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:10:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:10:56.231-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:10:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:11:26.422-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:11:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:11:56.697-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:11:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:12:26.981-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:12:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:12:57.357-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:12:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:13:27.622-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:13:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:13:57.788-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:13:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:14:27.934-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:14:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:14:58.182-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:14:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:15:28.465-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:15:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:15:58.747-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:15:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:16:29.026-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:16:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:16:59.287-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:16:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:17:29.543-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:17:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:17:59.947-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:17:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:18:30.201-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:18:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:19:00.476-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:19:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:19:30.633-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:19:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:20:00.934-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:20:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:20:31.195-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:20:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:21:01.478-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:21:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:21:31.750-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:21:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:22:02.042-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:22:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:22:32.305-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:22:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:23:02.771-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:23:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:23:33.167-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:23:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:24:03.468-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:24:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:24:33.765-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:24:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:25:04.025-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:25:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:25:34.306-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:25:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:26:04.443-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:26:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:26:34.737-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:26:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:27:04.880-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:27:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:27:35.347-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:27:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:28:05.609-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:28:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:28:35.852-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:28:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:29:06.059-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:29:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:29:36.226-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:29:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:30:06.614-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:30:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:30:36.816-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:30:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:31:07.079-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:31:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:31:37.421-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:31:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:32:07.715-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:32:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:32:38.011-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:32:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:33:08.333-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:33:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:33:38.601-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:33:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:34:08.802-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:34:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:34:39.039-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:34:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:35:09.274-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:35:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:35:39.441-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:35:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:36:09.715-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:36:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:36:40.064-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:36:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:37:10.360-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:37:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:37:40.667-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:37:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:38:10.825-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:38:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:38:41.092-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:38:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:39:11.323-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:39:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:39:41.711-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:39:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:40:11.925-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:40:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:40:42.201-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:40:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:41:12.444-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:41:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:41:42.717-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:41:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:42:12.850-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:42:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:42:43.118-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:42:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:43:13.316-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:43:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:43:43.605-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:43:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:44:13.887-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:44:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:44:44.033-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:44:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:45:14.320-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:45:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:45:44.500-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:45:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:46:14.902-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:46:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:46:45.100-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:46:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:47:15.386-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:47:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:47:45.781-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:47:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:48:16.044-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:48:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:48:46.219-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:48:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:49:16.456-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:49:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:49:46.721-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:49:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:50:17.055-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:50:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:50:47.316-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:50:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:51:17.457-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:51:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:51:47.738-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:51:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:52:17.983-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:52:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:52:48.242-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:52:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:53:18.501-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:53:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:53:48.826-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:53:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:54:19.085-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:54:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:54:49.482-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:54:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:55:19.968-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:55:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:55:50.323-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:55:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:56:20.594-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:56:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:56:50.892-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:56:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:57:21.167-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:57:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:57:51.458-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:57:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:58:21.710-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:58:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:58:51.994-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:58:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:59:22.331-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:59:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T07:59:52.625-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 07:59:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:00:22.894-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:00:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:00:53.179-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:00:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:01:23.507-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:01:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:01:53.779-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:01:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:02:23.961-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:02:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:02:54.283-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:02:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:03:24.524-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:03:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:03:54.826-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:03:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:04:25.092-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:04:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:04:55.257-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:04:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:05:25.645-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:05:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:05:55.806-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:05:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:06:26.022-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:06:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:06:56.345-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:06:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:07:26.532-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:07:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:07:56.811-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:07:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:08:27.046-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:08:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:08:57.313-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:08:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:09:27.584-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:09:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:09:57.861-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:09:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:10:28.019-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:10:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:10:58.196-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:10:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:11:28.469-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:11:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:11:58.798-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:11:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:12:29.047-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:12:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:12:59.287-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:12:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:13:29.659-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:13:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:13:59.991-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:13:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:14:30.253-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:14:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:15:00.496-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:15:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:15:30.763-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:15:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:16:01.105-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:16:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:16:31.400-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:16:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:17:01.684-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:17:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:17:31.903-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:17:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:18:02.185-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:18:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:18:32.420-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:18:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:19:02.638-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:19:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:19:32.904-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:19:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:20:03.183-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:20:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:20:33.474-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:20:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:21:03.713-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:21:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:21:33.979-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:21:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:22:04.253-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:22:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:22:34.607-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:22:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:23:04.947-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:23:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:23:35.293-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:23:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:24:05.575-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:24:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:24:35.899-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:24:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:25:06.263-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:25:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:25:36.544-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:25:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:26:06.886-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:26:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:26:37.132-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:26:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:27:07.404-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:27:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:27:37.723-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:27:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:28:07.894-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:28:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:28:38.198-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:28:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:29:08.503-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:29:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:29:38.729-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:29:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:30:08.951-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:30:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:30:39.167-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:30:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:31:09.412-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:31:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:31:39.749-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:31:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:32:10.048-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:32:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:32:40.324-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:32:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:33:10.526-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:33:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:33:40.931-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:33:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:34:11.210-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:34:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:34:41.522-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:34:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:35:11.766-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:35:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:35:42.124-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:35:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:36:12.395-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:36:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:36:42.694-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:36:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:37:12.965-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:37:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:37:43.181-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:37:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:38:13.464-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:38:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:38:43.704-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:38:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:39:13.995-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:39:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:39:44.302-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:39:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:40:14.557-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:40:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:40:44.816-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:40:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:41:15.116-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:41:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:41:45.270-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:41:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:42:15.548-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:42:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:42:45.820-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:42:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:43:16.094-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:43:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:43:46.284-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:43:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:44:16.425-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:44:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:44:46.690-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:44:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:45:17.013-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:45:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:45:47.349-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:45:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:46:17.551-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:46:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:46:47.734-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:46:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:47:18.089-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:47:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:47:48.339-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:47:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:48:18.610-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:48:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:48:48.912-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:48:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:49:19.239-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:49:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:49:49.559-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:49:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:50:19.699-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:50:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:50:50.077-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:50:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:51:20.361-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:51:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:51:50.547-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:51:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:52:20.809-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:52:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:52:51.097-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:52:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:53:21.392-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:53:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:53:51.656-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:53:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:54:21.913-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:54:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:54:52.267-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:54:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:55:22.536-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:55:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:55:52.829-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:55:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:56:23.118-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:56:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:56:53.398-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:56:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:57:23.647-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:57:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:57:53.800-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:57:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:58:24.077-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:58:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:58:54.352-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:58:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:59:24.678-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:59:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T08:59:54.997-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 08:59:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:00:25.167-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:00:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:00:55.391-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:00:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:01:25.669-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:01:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:01:56.093-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:01:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:02:26.318-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:02:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:02:56.698-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:02:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:03:27.106-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:03:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:03:57.396-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:03:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:04:27.763-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:04:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:04:58.033-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:04:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:05:28.348-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:05:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:05:58.639-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:05:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:06:28.952-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:06:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:06:59.306-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:06:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:07:29.512-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:07:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:07:59.729-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:07:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:08:30.017-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:08:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:09:00.431-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:09:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:09:30.773-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:09:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:10:01.048-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:10:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:10:31.388-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:10:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:11:01.658-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:11:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:11:31.973-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:11:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:12:02.267-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:12:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:12:32.469-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:12:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:13:02.831-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:13:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:13:33.055-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:13:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:14:03.360-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:14:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:14:33.631-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:14:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:15:03.938-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:15:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:15:34.191-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:15:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:16:04.555-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:16:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:16:34.914-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:16:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:17:05.215-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:17:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:17:35.489-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:17:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:18:05.774-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:18:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:18:36.074-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:18:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:19:06.220-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:19:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:19:36.455-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:19:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:20:06.739-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:20:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:20:36.967-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:20:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:21:07.241-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:21:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:21:37.528-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:21:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:22:07.765-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:22:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:22:38.094-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:22:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:23:08.415-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:23:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:23:38.703-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:23:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:24:08.985-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:24:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:24:39.334-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:24:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:25:09.698-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:25:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:25:39.999-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:25:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:26:10.282-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:26:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:26:40.633-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:26:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:27:10.930-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:27:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:27:41.212-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:27:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:28:11.520-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:28:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:28:41.897-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:28:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:29:12.227-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:29:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:29:42.446-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:29:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:30:12.745-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:30:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:30:42.980-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:30:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:31:13.231-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:31:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:31:43.540-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:31:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:32:13.861-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:32:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:32:44.044-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:32:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:33:14.334-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:33:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:33:44.711-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:33:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:34:15.016-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:34:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:34:45.290-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:34:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:35:15.587-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:35:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:35:45.865-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:35:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:36:16.147-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:36:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:36:46.415-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:36:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:37:16.819-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:37:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:37:47.319-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:37:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:38:17.455-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:38:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:38:47.724-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:38:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:39:18.115-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:39:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:39:48.241-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:39:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:40:18.457-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:40:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:40:48.611-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:40:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:41:18.897-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:41:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:41:49.109-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:41:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:42:19.384-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:42:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:42:49.608-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:42:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:43:19.912-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:43:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:43:50.061-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:43:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:44:20.248-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:44:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:44:50.542-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:44:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:45:20.825-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:45:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:45:50.992-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:45:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:46:21.129-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:46:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:46:51.422-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:46:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:47:21.708-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:47:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:47:51.995-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:47:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:48:22.312-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:48:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:48:52.572-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:48:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:49:22.980-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:49:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:49:53.252-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:49:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:50:23.564-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:50:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:50:53.815-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:50:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:51:24.113-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:51:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:51:54.412-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:51:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:52:24.695-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:52:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:52:54.991-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:52:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:53:25.270-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:53:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:53:55.565-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:53:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:54:25.768-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:54:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:54:56.053-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:54:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:55:26.204-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:55:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:55:56.494-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:55:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:56:26.762-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:56:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:56:57.088-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:56:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:57:27.375-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:57:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:57:57.533-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:57:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:58:27.913-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:58:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:58:58.182-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:58:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:59:28.483-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:59:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T09:59:58.767-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 09:59:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:00:29.060-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:00:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:00:59.349-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:00:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:01:29.627-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:01:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:01:59.789-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:01:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:02:29.948-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:02:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:03:00.266-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:02:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:03:30.559-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:03:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:04:00.746-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:04:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:04:31.018-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:04:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:05:01.195-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:05:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:05:31.407-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:05:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:06:01.697-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:06:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:06:31.995-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:06:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:07:02.379-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:07:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:07:32.679-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:07:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:08:03.060-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:08:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:08:33.429-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:08:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:09:03.848-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:09:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:09:34.220-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:09:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:10:04.520-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:10:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:10:34.815-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:10:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:11:05.096-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:11:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:11:35.373-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:11:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:12:05.586-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:12:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:12:36.021-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:12:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:13:06.348-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:13:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:13:36.699-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:13:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:14:07.010-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:14:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:14:37.282-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:14:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:15:07.675-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:15:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:15:37.908-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:15:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:16:08.205-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:16:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:16:38.546-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:16:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:17:08.830-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:17:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:17:39.083-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:17:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:18:09.423-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:18:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:18:39.738-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:18:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:19:10.111-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:19:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:19:40.541-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:19:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:20:10.855-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:20:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:20:41.221-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:20:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:21:11.487-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:21:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:21:41.671-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:21:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:22:11.886-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:22:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:22:42.195-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:22:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:23:12.355-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:23:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:23:42.668-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:23:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:24:12.838-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:24:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:24:43.161-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:24:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:25:13.406-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:25:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:25:43.705-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:25:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:26:13.981-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:26:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:26:44.155-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:26:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:27:14.372-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:27:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:27:44.685-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:27:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:28:14.935-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:28:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:28:45.171-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:28:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:29:15.492-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:29:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:29:45.800-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:29:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:30:16.005-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:30:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:30:46.398-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:30:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:31:16.708-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:31:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:31:46.969-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:31:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:32:17.280-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:32:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:32:47.629-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:32:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:33:17.905-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:33:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:33:48.340-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:33:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:34:18.629-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:34:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:34:48.846-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:34:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:35:19.218-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:35:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:35:49.410-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:35:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:36:19.721-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:36:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:36:50.068-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:36:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:37:20.222-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:37:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:37:50.547-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:37:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:38:20.877-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:38:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:38:51.215-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:38:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:39:21.397-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:39:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:39:51.570-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:39:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:40:21.807-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:40:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:40:52.080-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:40:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:41:22.445-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:41:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:41:52.684-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:41:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:42:22.921-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:42:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:42:53.300-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:42:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:43:23.687-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:43:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:43:53.918-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:43:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:44:24.079-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:44:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:44:54.354-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:44:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:45:24.615-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:45:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:45:54.818-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:45:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:46:25.076-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:46:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:46:55.293-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:46:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:47:25.546-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:47:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:47:55.801-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:47:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:48:26.077-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:48:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:48:56.351-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:48:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:49:26.585-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:49:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:49:56.835-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:49:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:50:27.051-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:50:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:50:57.348-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:50:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:51:27.586-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:51:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:51:57.872-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:51:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:52:28.103-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:52:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:52:58.393-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:52:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:53:28.716-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:53:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:53:59.169-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:53:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:54:29.490-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:54:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:54:59.825-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:54:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:55:30.235-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:55:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:56:00.502-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:56:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:56:30.884-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:56:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:57:01.109-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:57:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:57:31.291-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:57:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:58:01.675-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:58:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:58:31.910-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:58:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:59:02.167-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:59:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T10:59:32.505-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 10:59:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:00:02.734-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:00:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:00:33.032-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:00:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:01:03.307-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:01:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:01:33.584-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:01:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:02:03.824-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:02:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:02:34.086-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:02:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:03:04.318-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:03:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:03:34.626-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:03:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:04:04.900-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:04:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:04:35.192-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:04:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:05:05.483-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:05:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:05:35.809-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:05:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:06:06.078-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:06:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:06:36.433-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:06:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:07:06.787-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:07:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:07:37.151-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:07:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:08:07.467-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:08:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:08:37.831-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:08:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:09:08.095-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:09:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:09:38.349-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:09:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:10:08.590-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:10:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:10:38.813-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:10:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:11:09.053-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:11:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:11:39.389-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:11:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:12:09.738-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:12:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:12:39.955-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:12:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:13:10.264-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:13:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:13:40.477-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:13:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:14:10.701-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:14:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:14:41.059-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:14:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:15:11.330-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:15:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:15:41.547-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:15:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:16:11.799-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:16:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:16:42.122-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:16:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:17:12.505-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:17:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:17:42.764-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:17:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:18:13.062-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:18:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:18:43.289-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:18:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:19:13.489-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:19:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:19:43.777-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:19:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:20:14.104-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:20:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:20:44.402-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:20:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:21:14.644-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:21:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:21:44.965-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:21:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:22:15.212-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:22:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:22:45.485-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:22:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:23:15.724-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:23:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:23:46.011-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:23:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:24:16.295-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:24:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:24:46.711-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:24:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:25:16.998-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:25:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:25:47.267-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:25:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:26:17.608-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:26:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:26:47.821-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:26:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:27:18.180-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:27:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:27:48.472-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:27:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:28:18.772-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:28:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:28:49.060-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:28:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:29:19.269-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:29:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:29:49.472-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:29:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:30:19.761-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:30:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:30:50.048-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:30:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:31:20.335-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:31:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:31:50.596-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:31:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:32:20.889-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:32:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:32:51.116-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:32:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:33:21.375-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:33:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:33:51.716-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:33:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:34:22.105-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:34:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:34:52.403-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:34:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:35:22.684-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:35:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:35:53.009-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:35:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:36:23.336-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:36:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:36:53.594-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:36:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:37:23.945-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:37:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:37:54.303-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:37:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:38:24.613-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:38:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:38:55.006-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:38:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:39:25.278-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:39:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:39:55.648-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:39:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:40:26.078-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:40:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:40:56.367-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:40:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:41:26.662-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:41:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:41:56.988-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:41:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:42:27.294-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:42:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:42:57.607-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:42:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:43:27.942-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:43:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:43:58.226-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:43:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:44:28.467-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:44:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:44:58.731-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:44:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:45:29.179-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:45:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:45:59.644-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:45:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:46:29.913-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:46:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:47:00.156-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:46:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:47:30.462-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:47:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:48:00.728-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:48:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:48:31.099-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:48:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:49:01.383-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:49:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:49:31.808-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:49:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:50:02.131-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:50:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:50:32.409-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:50:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:51:02.736-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:51:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:51:33.027-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:51:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:52:03.244-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:52:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:52:33.508-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:52:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:53:03.764-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:53:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:53:34.144-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:53:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:54:04.511-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:54:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:54:34.875-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:54:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:55:05.009-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:55:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:55:35.310-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:55:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:56:05.595-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:56:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:56:35.796-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:56:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:57:06.099-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:57:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:57:36.479-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:57:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:58:06.626-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:58:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:58:36.878-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:58:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:59:07.461-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:59:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T11:59:37.602-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 11:59:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:00:07.921-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:00:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:00:38.224-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:00:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:01:08.598-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:01:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:01:38.874-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:01:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:02:09.239-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:02:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:02:39.474-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:02:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:03:09.750-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:03:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:03:39.992-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:03:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:04:10.166-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:04:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:04:40.449-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:04:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:05:10.703-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:05:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:05:40.885-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:05:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:06:11.184-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:06:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:06:41.449-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:06:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:07:11.905-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:07:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:07:42.184-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:07:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:08:12.444-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:08:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:08:42.671-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:08:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:09:12.977-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:09:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:09:43.286-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:09:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:10:13.552-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:10:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:10:43.829-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:10:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:11:14.119-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:11:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:11:44.390-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:11:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:12:14.679-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:12:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:12:44.952-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:12:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:13:15.310-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:13:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:13:45.552-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:13:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:14:15.815-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:14:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:14:46.114-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:14:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:15:16.418-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:15:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:15:46.736-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:15:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:16:17.047-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:16:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:16:47.464-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:16:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:17:17.629-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:17:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:17:47.889-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:17:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:18:18.280-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:18:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:18:48.663-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:18:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:19:18.863-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:19:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:19:49.139-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:19:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:20:19.402-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:20:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:20:49.547-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:20:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:21:19.713-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:21:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:21:50.000-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:21:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:22:20.200-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:22:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:22:50.533-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:22:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:23:20.746-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:23:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:23:51.117-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:23:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:24:21.316-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:24:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:24:51.612-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:24:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:25:21.777-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:25:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:25:52.151-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:25:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:26:22.308-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:26:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:26:52.464-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:26:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:27:22.729-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:27:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:27:52.978-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:27:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:28:23.244-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:28:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:28:53.542-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:28:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:29:23.697-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:29:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:29:53.853-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:29:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:30:24.123-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:30:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:30:54.384-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:30:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:31:24.629-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:31:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:31:54.917-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:31:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:32:25.251-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:32:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:32:55.615-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:32:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:33:25.983-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:33:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:33:56.361-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:33:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:34:26.531-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:34:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:34:56.819-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:34:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:35:27.088-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:35:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:35:57.343-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:35:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:36:27.642-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:36:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:36:57.955-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:36:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:37:28.285-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:37:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:37:58.557-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:37:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:38:28.767-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:38:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:38:59.012-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:38:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:39:29.248-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:39:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:39:59.539-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:39:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:40:29.830-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:40:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:41:00.201-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:40:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:41:30.465-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:41:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:42:00.614-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:42:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:42:30.945-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:42:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:43:01.299-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:43:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:43:31.581-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:43:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:44:01.906-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:44:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:44:32.157-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:44:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:45:02.444-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:45:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:45:32.628-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:45:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:46:02.979-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:46:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:46:33.225-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:46:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:47:03.453-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:47:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:47:33.717-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:47:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:48:04.019-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:48:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:48:34.313-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:48:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:49:04.476-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:49:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:49:34.681-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:49:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:50:04.973-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:50:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:50:35.114-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:50:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:51:05.395-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:51:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:51:35.775-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:51:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:52:06.044-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:52:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:52:36.321-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:52:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:53:06.573-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:53:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:53:36.852-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:53:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:54:07.039-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:54:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:54:37.335-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:54:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:55:07.506-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:55:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:55:37.782-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:55:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:56:07.998-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:56:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:56:38.285-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:56:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:57:08.453-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:57:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:57:38.742-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:57:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:58:09.079-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:58:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:58:39.343-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:58:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:59:09.665-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:59:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T12:59:39.978-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 12:59:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:00:10.288-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:00:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:00:40.634-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:00:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:01:10.938-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:01:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:01:41.104-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:01:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:02:11.458-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:02:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:02:41.762-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:02:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:03:12.128-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:03:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:03:42.403-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:03:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:04:12.678-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:04:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:04:42.967-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:04:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:05:13.210-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:05:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:05:43.489-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:05:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:06:13.838-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:06:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:06:44.241-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:06:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:07:14.599-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:07:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:07:45.058-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:07:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:08:15.478-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:08:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:08:45.679-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:08:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:09:15.961-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:09:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:09:46.275-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:09:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:10:16.561-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:10:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:10:46.788-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:10:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:11:17.060-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:11:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:11:47.283-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:11:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:12:17.574-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:12:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:12:47.819-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:12:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:13:18.081-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:13:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:13:48.371-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:13:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:14:18.646-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:14:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:14:48.940-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:14:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:15:19.108-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:15:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:15:49.455-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:15:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:16:19.743-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:16:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:16:50.016-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:16:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:17:20.335-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:17:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:17:50.644-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:17:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:18:20.912-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:18:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:18:51.196-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:18:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:19:21.557-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:19:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:19:51.795-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:19:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:20:22.070-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:20:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:20:52.507-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:20:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:21:22.840-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:21:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:21:53.118-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:21:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:22:23.323-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:22:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:22:53.630-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:22:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:23:23.757-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:23:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:23:54.024-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:23:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:24:24.357-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:24:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:24:54.691-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:24:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:25:24.971-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:25:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:25:55.263-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:25:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:26:25.558-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:26:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:26:55.722-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:26:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:27:26.089-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:27:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:27:56.344-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:27:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:28:26.606-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:28:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:28:56.799-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:28:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:29:26.956-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:29:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:29:57.185-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:29:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:30:27.387-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:30:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:30:57.785-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:30:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:31:28.066-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:31:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:31:58.377-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:31:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:32:28.668-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:32:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:32:58.988-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:32:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:33:29.268-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:33:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:33:59.514-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:33:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:34:29.796-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:34:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:34:59.966-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:34:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:35:30.114-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:35:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:36:00.454-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:36:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:36:30.689-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:36:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:37:00.954-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:37:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:37:31.394-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:37:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:38:01.667-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:38:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:38:31.960-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:38:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:39:02.287-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:39:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:39:32.583-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:39:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:40:02.878-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:40:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:40:33.275-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:40:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:41:03.444-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:41:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:41:33.751-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:41:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:42:04.040-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:42:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:42:34.275-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:42:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:43:04.612-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:43:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:43:34.909-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:43:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:44:05.182-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:44:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:44:35.523-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:44:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:45:05.922-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:45:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:45:36.188-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:45:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:46:06.486-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:46:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:46:36.635-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:46:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:47:06.780-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:47:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:47:37.100-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:47:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:48:07.376-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:48:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:48:37.637-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:48:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:49:07.904-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:49:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:49:38.202-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:49:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:50:08.460-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:50:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:50:38.890-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:50:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:51:09.189-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:51:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:51:39.487-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:51:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:52:09.761-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:52:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:52:40.053-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:52:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:53:10.274-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:53:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:53:40.536-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:53:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:54:10.863-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:54:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:54:41.143-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:54:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:55:11.421-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:55:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:55:41.721-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:55:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:56:11.997-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:56:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:56:42.158-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:56:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:57:12.541-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:57:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:57:42.873-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:57:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:58:13.139-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:58:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:58:43.331-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:58:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:59:15.074-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:59:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T13:59:45.453-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 13:59:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:00:15.713-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:00:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:00:45.878-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:00:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:01:16.164-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:01:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:01:46.451-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:01:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:02:16.767-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:02:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:02:47.095-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:02:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:03:17.380-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:03:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:03:47.617-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:03:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:04:17.930-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:04:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:04:48.342-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:04:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:05:18.585-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:05:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:05:48.850-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:05:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:06:19.057-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:06:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:06:49.328-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:06:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:07:19.608-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:07:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:07:49.870-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:07:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:08:20.108-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:08:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:08:50.397-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:08:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:09:20.796-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:09:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:09:51.074-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:09:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:10:21.479-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:10:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:10:51.709-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:10:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:11:22.009-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:11:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:11:52.454-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:11:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:12:22.651-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:12:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:12:52.987-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:12:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:13:23.261-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:13:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:13:53.593-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:13:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:14:23.751-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:14:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:14:54.028-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:14:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:15:24.347-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:15:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:15:54.624-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:15:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:16:24.906-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:16:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:16:55.209-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:16:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:17:25.544-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:17:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:17:55.869-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:17:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:18:26.175-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:18:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:18:56.360-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:18:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:19:26.583-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:19:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:19:56.868-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:19:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:20:27.287-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:20:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:20:57.567-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:20:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:21:27.953-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:21:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:21:58.221-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:21:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:22:28.484-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:22:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:22:58.854-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:22:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:23:29.143-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:23:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:23:59.409-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:23:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:24:29.698-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:24:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:24:59.874-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:24:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:25:30.184-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:25:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:26:00.377-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:26:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:26:30.648-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:26:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:27:00.931-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:27:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:27:31.205-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:27:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:28:01.499-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:28:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:28:31.799-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:28:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:29:02.190-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:29:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:29:32.365-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:29:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:30:02.734-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:30:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:30:32.870-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:30:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:31:03.143-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:31:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:31:33.329-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:31:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:32:03.520-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:32:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:32:33.796-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:32:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:33:04.050-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:33:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:33:34.211-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:33:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:34:04.451-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:34:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:34:34.724-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:34:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:35:04.874-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:35:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:35:35.163-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:35:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:36:05.358-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:36:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:36:35.771-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:36:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:37:05.908-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:37:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:37:36.268-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:37:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:38:06.524-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:38:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:38:36.749-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:38:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:39:06.935-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:39:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:39:37.285-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:39:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:40:07.552-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:40:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:40:37.783-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:40:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:41:08.061-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:41:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:41:38.233-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:41:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:42:08.422-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:42:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:42:38.688-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:42:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:43:08.896-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:43:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:43:39.135-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:43:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:44:09.398-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:44:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:44:39.536-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:44:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:45:09.846-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:45:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:45:40.105-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:45:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:46:10.376-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:46:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:46:40.512-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:46:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:47:10.800-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:47:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:47:41.083-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:47:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:48:11.364-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:48:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:48:41.509-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:48:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:49:11.906-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:49:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:49:42.065-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:49:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:50:12.492-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:50:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:50:42.750-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:50:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:51:13.062-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:51:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:51:43.351-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:51:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:52:13.636-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:52:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:52:43.800-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:52:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:53:14.081-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:53:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:53:44.262-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:53:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:54:14.558-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:54:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:54:44.707-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:54:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:55:14.917-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:55:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:55:45.236-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:55:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:56:15.381-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:56:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:56:45.623-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:56:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:57:15.911-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:57:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:57:46.151-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:57:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:58:16.339-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:58:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:58:46.625-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:58:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:59:16.894-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:59:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T14:59:47.188-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 14:59:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:00:17.474-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:00:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:00:47.757-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:00:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:01:18.076-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:01:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:01:48.258-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:01:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:02:18.661-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:02:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:02:48.920-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:02:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:03:19.218-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:03:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:03:49.518-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:03:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:04:19.805-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:04:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:04:50.039-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:04:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:05:20.337-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:05:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:05:50.628-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:05:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:06:20.918-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:06:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:06:51.349-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:06:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:07:21.727-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:07:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:07:51.984-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:07:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:08:22.267-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:08:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:08:52.500-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:08:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:09:22.983-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:09:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:09:53.255-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:09:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:10:23.655-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:10:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:10:54.085-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:10:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:11:24.373-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:11:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:11:54.576-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:11:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:12:24.840-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:12:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:12:55.024-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:12:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:13:25.302-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:13:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:13:55.563-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:13:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:14:26.035-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:14:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:14:56.213-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:14:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:15:26.364-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:15:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:15:56.678-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:15:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:16:26.960-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:16:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:16:57.148-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:16:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:17:27.419-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:17:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:17:57.718-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:17:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:18:28.125-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:18:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:18:58.614-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:18:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:19:28.910-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:19:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:19:59.100-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:19:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:20:29.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:20:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:20:59.759-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:20:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:21:30.105-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:21:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:22:00.399-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:22:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:22:30.599-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:22:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:23:00.866-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:23:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:23:31.143-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:23:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:24:01.379-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:24:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:24:31.757-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:24:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:25:02.137-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:25:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:25:32.299-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:25:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:26:02.548-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:26:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:26:32.687-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:26:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:27:02.965-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:27:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:27:33.104-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:27:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:28:03.509-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:28:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:28:33.844-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:28:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:29:04.112-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:29:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:29:34.539-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:29:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:30:04.836-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:30:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:30:35.034-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:30:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:31:05.328-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:31:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:31:35.641-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:31:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:32:05.953-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:32:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:32:36.253-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:32:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:33:06.539-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:33:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:33:36.682-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:33:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:34:06.890-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:34:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:34:37.176-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:34:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:35:07.449-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:35:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:35:37.746-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:35:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:36:08.106-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:36:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:36:38.375-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:36:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:37:08.558-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:37:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:37:38.836-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:37:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:38:09.120-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:38:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:38:39.443-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:38:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:39:09.722-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:39:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:39:39.931-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:39:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:40:10.309-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:40:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:40:40.700-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:40:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:41:10.986-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:41:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:41:41.191-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:41:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:42:11.447-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:42:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:42:41.722-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:42:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:43:12.132-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:43:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:43:42.567-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:43:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:44:12.844-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:44:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:44:43.102-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:44:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:45:13.477-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:45:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:45:43.774-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:45:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:46:14.147-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:46:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:46:44.535-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:46:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:47:14.747-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:47:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:47:45.044-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:47:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:48:15.360-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:48:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:48:45.653-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:48:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:49:15.841-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:49:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:49:46.136-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:49:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:50:16.488-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:50:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:50:46.753-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:50:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:51:17.035-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:51:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:51:47.193-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:51:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:52:17.439-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:52:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:52:47.797-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:52:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:53:17.988-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:53:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:53:48.291-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:53:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:54:18.559-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:54:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:54:48.716-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:54:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:55:18.995-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:55:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:55:49.286-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:55:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:56:19.593-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:56:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:56:49.873-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:56:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:57:20.073-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:57:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:57:50.405-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:57:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:58:20.707-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:58:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:58:50.904-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:58:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:59:21.119-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:59:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T15:59:51.254-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 15:59:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:00:21.652-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:00:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:00:51.924-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:00:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:01:22.222-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:01:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:01:52.453-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:01:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:02:22.838-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:02:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:02:52.996-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:02:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:03:23.155-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:03:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:03:53.455-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:03:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:04:23.765-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:04:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:04:54.194-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:04:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:05:24.501-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:05:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:05:54.720-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:05:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:06:25.021-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:06:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:06:55.316-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:06:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:07:25.562-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:07:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:07:55.882-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:07:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:08:26.030-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:08:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:08:56.409-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:08:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:09:26.687-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:09:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:09:56.962-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:09:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:10:27.350-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:10:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:10:57.645-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:10:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:11:28.018-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:11:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:11:58.396-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:11:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:12:28.680-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:12:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:12:59.011-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:12:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:13:29.341-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:13:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:13:59.602-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:13:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:14:30.104-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:14:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:15:00.490-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:15:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:15:30.784-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:15:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:16:01.172-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:16:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:16:31.473-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:16:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:17:01.748-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:17:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:17:32.127-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:17:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:18:02.408-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:18:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:18:32.790-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:18:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:19:03.117-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:19:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:19:33.441-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:19:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:20:03.742-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:20:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:20:33.983-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:20:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:21:04.280-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:21:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:21:34.516-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:21:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:22:04.896-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:22:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:22:35.334-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:22:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:23:05.734-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:23:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:23:35.999-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:23:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:24:06.332-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:24:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:24:36.556-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:24:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:25:06.761-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:25:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:25:36.912-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:25:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:26:07.198-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:26:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:26:37.471-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:26:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:27:07.792-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:27:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:27:37.984-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:27:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:28:08.286-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:28:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:28:38.614-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:28:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:29:08.900-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:29:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:29:39.190-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:29:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:30:09.458-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:30:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:30:39.725-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:30:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:31:09.870-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:31:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:31:40.157-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:31:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:32:10.452-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:32:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:32:40.630-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:32:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:33:11.009-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:33:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:33:41.330-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:33:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:34:11.671-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:34:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:34:41.941-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:34:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:35:12.267-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:35:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:35:42.597-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:35:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:36:12.736-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:36:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:36:42.975-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:36:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:37:13.281-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:37:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:37:43.460-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:37:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:38:13.861-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:38:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:38:44.091-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:38:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:39:14.430-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:39:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:39:44.730-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:39:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:40:15.076-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:40:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:40:45.368-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:40:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:41:15.658-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:41:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:41:45.844-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:41:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:42:16.149-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:42:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:42:46.529-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:42:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:43:16.871-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:43:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:43:47.147-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:43:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:44:17.436-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:44:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:44:47.738-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:44:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:45:18.045-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:45:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:45:48.338-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:45:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:46:18.771-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:46:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:46:49.146-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:46:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:47:19.415-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:47:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:47:49.683-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:47:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:48:19.972-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:48:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:48:50.165-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:48:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:49:20.480-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:49:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:49:50.761-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:49:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:50:21.154-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:50:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:50:51.428-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:50:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:51:21.639-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:51:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:51:51.918-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:51:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:52:22.282-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:52:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:52:52.458-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:52:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:53:22.727-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:53:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:53:53.005-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:53:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:54:23.285-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:54:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:54:53.554-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:54:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:55:23.866-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:55:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:55:54.144-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:55:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:56:24.305-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:56:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:56:54.515-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:56:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:57:24.838-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:57:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:57:55.057-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:57:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:58:25.295-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:58:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:58:55.621-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:58:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:59:25.780-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:59:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T16:59:56.142-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 16:59:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:00:26.403-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:00:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:00:56.619-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:00:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:01:26.936-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:01:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:01:57.158-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:01:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:02:27.459-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:02:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:02:57.878-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:02:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:03:28.136-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:03:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:03:58.279-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:03:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:04:28.716-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:04:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:04:58.996-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:04:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:05:29.283-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:05:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:05:59.584-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:05:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:06:29.854-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:06:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:07:00.148-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:06:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:07:30.472-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:07:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:07:55.456-0500 [conn10] authenticate db: historyDb { authenticate: 1, user: "its_rw", nonce: "xxx", key: "xxx" } 2017-01-25T17:08:00.739-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:08:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:08:31.005-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:08:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:08:35.327-0500 [conn11] authenticate db: historyDb { authenticate: 1, user: "its_rw", nonce: "xxx", key: "xxx" } 2017-01-25T17:08:47.166-0500 [conn12] authenticate db: historyDb { authenticate: 1, user: "its_rw", nonce: "xxx", key: "xxx" } 2017-01-25T17:09:01.308-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:09:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:09:31.638-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:09:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:10:01.923-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:10:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:10:32.232-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:10:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:11:02.434-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:11:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:11:32.597-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:11:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:12:02.871-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:12:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:12:31.594-0500 [conn13] authenticate db: historyDb { authenticate: 1, user: "its_rw", nonce: "xxx", key: "xxx" } 2017-01-25T17:12:33.132-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:12:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:13:03.432-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:13:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:13:33.799-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:13:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:14:04.065-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:14:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:14:34.255-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:14:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:15:04.546-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:15:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:15:35.036-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:15:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:16:05.324-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:16:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:16:35.591-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:16:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:17:05.888-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:17:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:17:36.193-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:17:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:18:06.439-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:18:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:18:36.823-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:18:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:19:07.098-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:19:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:19:37.577-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:19:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:20:07.747-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:20:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:20:37.932-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:20:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:21:08.228-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:21:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:21:38.368-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:21:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:22:08.654-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:22:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:22:38.927-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:22:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:23:09.218-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:23:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:23:39.565-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:23:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:24:09.854-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:24:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:24:40.201-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:24:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:25:10.468-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:25:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:25:40.757-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:25:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:26:11.070-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:26:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:26:13.118-0500 [conn14] authenticate db: historyDb { authenticate: 1, user: "its_rw", nonce: "xxx", key: "xxx" } 2017-01-25T17:26:41.265-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:26:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:27:11.553-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:27:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:27:41.873-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:27:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:28:12.253-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:28:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:28:42.518-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:28:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:29:12.780-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:29:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:29:43.079-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:29:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:30:13.321-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:30:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:30:43.564-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:30:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:31:13.834-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:31:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:31:44.066-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:31:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:32:14.413-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:32:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:32:44.675-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:32:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:33:14.940-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:33:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:33:45.178-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:33:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:34:15.384-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:34:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:34:45.791-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:34:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:35:15.951-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:35:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:35:46.101-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:35:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:36:16.375-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:36:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:36:46.637-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:36:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:37:16.987-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:37:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:37:47.281-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:37:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:38:17.528-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:38:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:38:47.821-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:38:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:39:18.111-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:39:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:39:48.386-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:39:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:40:18.758-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:40:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:40:49.053-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:40:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:41:19.350-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:41:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:41:49.626-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:41:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:42:19.914-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:42:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:42:50.120-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:42:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:43:20.246-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:43:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:43:50.543-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:43:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:44:20.824-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:44:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:44:51.091-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:44:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:45:21.500-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:45:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:45:51.752-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:45:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:46:21.946-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:46:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:46:52.204-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:46:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:47:22.619-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:47:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:47:52.991-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:47:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:48:23.274-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:48:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:48:53.541-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:48:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:49:23.704-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:49:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:49:54.033-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:49:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:50:24.329-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:50:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:50:54.522-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:50:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:51:24.792-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:51:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:51:55.081-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:51:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:52:25.279-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:52:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:52:55.486-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:52:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:53:25.899-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:53:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:53:56.258-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:53:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:54:26.542-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:54:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:54:56.823-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:54:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:55:27.100-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:55:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:55:57.441-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:55:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:56:27.683-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:56:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:56:58.060-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:56:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:57:28.319-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:57:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:57:58.599-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:57:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:58:28.860-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:58:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:58:59.154-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:58:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:59:29.432-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:59:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T17:59:59.807-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 17:59:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:00:30.069-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:00:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:01:00.241-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:01:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:01:30.489-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:01:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:02:00.694-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:02:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:02:31.019-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:02:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:03:01.316-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:03:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:03:31.604-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:03:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:04:01.878-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:04:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:04:32.156-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:04:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:05:02.534-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:05:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:05:32.697-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:05:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:06:02.975-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:06:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:06:33.304-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:06:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:07:03.587-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:07:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:07:33.749-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:07:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:08:03.968-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:08:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:08:34.260-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:08:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:09:04.446-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:09:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:09:34.683-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:09:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:10:04.841-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:10:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:10:35.124-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:10:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:11:05.441-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:11:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:11:35.736-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:11:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:12:06.039-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:12:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:12:36.200-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:12:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:13:06.491-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:13:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:13:36.760-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:13:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:14:07.023-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:14:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:14:37.288-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:14:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:15:07.450-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:15:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:15:37.728-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:15:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:16:08.013-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:16:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:16:38.328-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:16:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:17:08.611-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:17:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:17:38.997-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:17:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:18:09.276-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:18:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:18:39.652-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:18:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:19:09.985-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:19:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:19:40.190-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:19:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:20:10.420-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:20:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:20:40.711-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:20:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:21:11.067-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:21:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:21:41.393-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:21:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:22:11.732-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:22:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:22:41.993-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:22:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:23:12.131-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:23:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:23:42.283-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:23:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:24:12.496-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:24:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:24:42.795-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:24:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:25:13.053-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:25:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:25:43.468-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:25:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:26:12.285-0500 [conn15] authenticate db: historyDb { authenticate: 1, user: "its_rw", nonce: "xxx", key: "xxx" } 2017-01-25T18:26:13.622-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:26:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:26:44.086-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:26:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:27:14.347-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:27:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:27:44.627-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:27:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:28:14.917-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:28:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:28:45.260-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:28:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:29:15.579-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:29:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:29:45.845-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:29:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:30:16.078-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:30:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:30:46.346-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:30:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:31:16.646-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:31:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:31:46.930-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:31:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:32:17.213-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:32:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:32:47.493-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:32:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:33:17.786-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:33:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:33:48.058-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:33:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:34:18.201-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:34:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:34:48.473-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:34:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:35:18.762-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:35:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:35:49.059-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:35:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:36:19.348-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:36:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:36:49.606-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:36:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:37:19.913-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:37:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:37:50.207-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:37:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:38:20.475-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:38:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:38:50.965-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:38:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:39:21.246-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:39:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:39:51.567-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:39:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:40:21.899-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:40:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:40:52.247-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:40:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:41:22.569-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:41:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:41:52.861-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:41:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:42:23.145-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:42:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:42:53.477-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:42:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:43:23.740-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:43:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:43:54.010-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:43:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:44:24.211-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:44:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:44:54.495-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:44:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:45:24.778-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:45:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:45:55.139-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:45:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:46:25.284-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:46:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:46:55.579-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:46:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:47:25.847-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:47:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:47:56.138-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:47:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:48:26.465-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:48:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:48:56.808-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:48:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:49:27.085-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:49:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:49:57.366-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:49:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:50:27.636-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:50:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:50:57.925-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:50:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:51:28.118-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:51:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:51:58.378-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:51:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:52:28.668-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:52:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:52:58.820-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:52:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:53:28.979-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:53:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:53:59.233-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:53:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:54:29.502-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:54:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:54:59.787-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:54:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:55:30.082-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:55:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:56:00.385-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:56:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:56:30.647-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:56:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:57:00.793-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:57:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:57:31.021-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:57:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:58:01.298-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:58:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:58:31.571-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:58:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:59:01.831-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:59:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T18:59:32.154-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 18:59:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:00:02.477-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:00:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:00:32.681-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:00:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:01:02.872-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:01:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:01:33.123-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:01:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:02:03.415-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:02:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:02:33.683-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:02:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:03:03.958-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:03:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:03:34.242-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:03:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:04:04.511-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:04:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:04:34.748-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:04:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:05:05.046-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:05:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:05:35.348-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:05:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:06:05.636-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:06:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:06:35.903-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:06:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:07:06.189-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:07:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:07:36.395-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:07:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:08:06.683-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:08:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:08:36.946-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:08:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:09:07.221-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:09:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:09:37.514-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:09:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:10:07.834-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:10:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:10:38.040-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:10:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:11:08.301-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:11:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:11:38.544-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:11:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:12:08.751-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:12:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:12:39.038-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:12:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:13:09.299-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:13:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:13:39.575-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:13:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:14:09.824-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:14:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:14:40.114-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:14:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:15:10.494-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:15:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:15:40.737-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:15:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:16:10.999-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:16:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:16:41.284-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:16:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:17:11.576-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:17:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:17:41.850-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:17:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:18:12.101-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:18:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:18:42.295-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:18:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:19:12.593-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:19:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:19:42.961-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:19:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:20:13.101-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:20:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:20:43.383-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:20:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:21:13.624-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:21:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:21:43.793-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:21:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:22:14.058-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:22:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:22:44.333-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:22:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:23:14.527-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:23:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:23:44.811-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:23:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:24:15.111-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:24:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:24:45.378-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:24:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:25:15.647-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:25:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:25:45.809-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:25:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:26:16.110-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:26:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:26:46.499-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:26:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:27:16.758-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:27:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:27:47.025-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:27:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:28:17.295-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:28:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:28:47.624-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:28:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:29:17.917-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:29:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:29:48.191-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:29:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:30:18.458-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:30:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:30:48.745-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:30:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:31:19.046-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:31:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:31:49.336-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:31:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:32:19.691-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:32:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:32:50.078-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:32:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:33:20.355-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:33:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:33:50.731-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:33:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:34:21.023-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:34:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:34:51.308-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:34:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:35:21.700-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:35:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:35:51.958-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:35:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:36:22.318-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:36:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:36:52.595-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:36:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:37:22.892-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:37:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:37:53.211-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:37:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:38:23.528-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:38:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:38:53.727-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:38:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:39:24.015-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:39:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:39:54.341-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:39:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:40:24.601-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:40:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:40:54.859-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:40:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:41:25.136-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:41:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:41:55.465-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:41:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:42:25.797-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:42:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:42:56.074-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:42:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:43:26.343-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:43:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:43:56.617-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:43:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:44:26.889-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:44:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:44:57.453-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:44:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:45:27.732-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:45:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:45:58.010-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:45:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:46:28.320-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:46:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:46:58.706-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:46:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:47:28.989-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:47:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:47:59.287-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:47:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:48:29.566-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:48:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:48:59.878-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:48:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:49:30.250-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:49:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:50:00.529-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:50:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:50:30.871-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:50:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:51:01.163-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:51:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:51:31.366-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:51:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:52:01.639-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:52:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:52:31.995-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:52:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:53:02.305-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:53:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:53:32.585-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:53:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:54:02.854-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:54:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:54:33.104-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:54:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:55:03.456-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:55:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:55:33.623-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:55:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:56:03.909-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:56:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:56:34.060-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:56:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:57:04.309-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:57:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:57:34.583-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:57:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:58:04.783-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:58:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:58:35.001-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:58:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:59:05.265-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:59:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T19:59:35.414-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 19:59:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:00:05.639-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:00:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:00:35.908-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:00:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:01:06.222-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:01:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:01:36.451-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:01:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:02:06.796-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:02:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:02:37.126-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:02:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:03:07.377-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:03:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:03:37.551-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:03:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:04:07.844-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:04:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:04:38.128-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:04:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:05:08.266-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:05:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:05:38.541-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:05:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:06:08.844-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:06:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:06:39.153-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:06:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:07:09.332-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:07:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:07:39.634-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:07:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:08:09.929-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:08:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:08:40.300-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:08:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:09:10.600-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:09:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:09:40.966-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:09:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:10:11.246-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:10:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:10:41.400-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:10:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:11:11.730-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:11:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:11:42.006-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:11:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:12:12.236-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:12:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:12:42.510-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:12:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:13:12.700-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:13:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:13:43.073-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:13:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:14:13.349-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:14:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:14:43.671-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:14:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:15:13.928-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:15:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:15:44.312-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:15:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:16:14.560-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:16:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:16:44.846-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:16:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:17:15.100-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:17:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:17:45.367-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:17:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:18:15.656-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:18:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:18:45.930-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:18:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:19:16.143-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:19:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:19:46.575-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:19:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:20:16.882-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:20:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:20:47.172-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:20:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:21:17.461-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:21:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:21:47.863-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:21:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:22:18.198-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:22:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:22:48.439-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:22:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:23:18.721-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:23:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:23:48.847-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:23:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:24:19.044-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:24:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:24:49.181-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:24:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:25:19.389-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:25:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:25:49.552-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:25:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:26:19.746-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:26:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:26:50.019-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:26:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:27:20.255-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:27:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:27:50.556-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:27:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:28:20.846-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:28:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:28:50.984-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:28:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:29:21.264-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:29:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:29:51.559-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:29:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:30:21.859-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:30:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:30:52.142-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:30:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:31:22.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:31:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:31:52.698-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:31:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:32:22.951-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:32:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:32:53.154-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:32:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:33:23.441-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:33:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:33:53.703-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:33:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:34:23.928-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:34:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:34:54.189-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:34:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:35:24.500-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:35:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:35:54.764-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:35:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:36:25.045-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:36:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:36:55.188-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:36:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:37:25.527-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:37:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:37:55.910-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:37:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:38:26.122-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:38:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:38:56.427-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:38:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:39:26.814-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:39:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:39:57.095-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:39:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:40:27.350-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:40:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:40:57.631-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:40:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:41:27.926-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:41:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:41:58.343-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:41:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:42:28.633-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:42:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:42:58.927-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:42:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:43:29.190-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:43:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:43:59.493-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:43:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:44:29.795-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:44:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:45:00.068-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:44:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:45:30.345-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:45:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:46:00.603-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:46:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:46:30.862-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:46:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:47:01.025-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:47:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:47:31.317-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:47:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:48:01.458-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:48:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:48:31.709-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:48:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:49:02.003-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:49:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:49:32.349-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:49:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:50:02.633-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:50:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:50:32.893-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:50:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:51:03.135-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:51:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:51:33.432-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:51:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:52:03.694-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:52:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:52:34.018-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:52:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:53:04.183-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:53:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:53:34.409-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:53:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:54:04.696-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:54:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:54:34.958-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:54:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:55:05.218-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:55:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:55:35.509-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:55:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:56:05.771-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:56:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:56:36.060-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:56:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:57:06.345-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:57:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:57:36.757-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:57:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:58:06.897-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:58:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:58:37.182-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:58:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:59:07.472-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:59:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T20:59:37.795-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 20:59:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:00:08.087-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:00:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:00:38.390-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:00:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:01:08.738-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:01:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:01:38.944-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:01:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:02:09.302-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:02:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:02:39.592-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:02:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:03:09.882-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:03:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:03:40.197-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:03:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:04:10.458-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:04:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:04:40.743-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:04:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:05:11.000-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:05:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:05:41.275-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:05:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:06:11.576-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:06:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:06:41.849-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:06:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:07:12.243-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:07:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:07:42.406-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:07:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:08:12.666-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:08:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:08:42.958-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:08:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:09:13.212-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:09:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:09:43.428-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:09:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:10:13.583-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:10:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:10:43.877-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:10:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:11:14.143-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:11:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:11:44.397-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:11:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:12:14.675-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:12:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:12:45.130-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:12:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:13:15.353-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:13:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:13:45.617-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:13:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:14:15.882-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:14:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:14:46.200-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:14:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:15:16.602-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:15:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:15:46.895-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:15:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:16:17.205-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:16:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:16:47.506-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:16:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:17:17.690-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:17:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:17:47.855-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:17:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:18:18.152-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:18:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:18:48.672-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:18:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:19:18.932-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:19:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:19:49.213-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:19:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:20:19.519-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:20:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:20:49.755-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:20:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:21:20.021-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:21:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:21:50.237-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:21:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:22:20.476-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:22:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:22:50.768-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:22:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:23:21.069-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:23:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:23:51.557-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:23:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:24:21.838-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:24:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:24:52.127-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:24:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:25:22.407-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:25:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:25:52.617-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:25:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:26:22.798-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:26:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:26:52.978-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:26:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:27:23.129-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:27:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:27:53.457-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:27:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:28:23.780-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:28:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:28:53.944-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:28:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:29:24.321-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:29:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:29:54.623-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:29:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:30:24.957-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:30:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:30:55.154-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:30:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:31:25.508-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:31:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:31:55.795-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:31:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:32:26.079-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:32:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:32:56.388-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:32:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:33:26.729-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:33:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:33:57.008-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:33:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:34:27.227-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:34:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:34:57.522-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:34:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:35:27.814-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:35:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:35:58.156-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:35:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:36:28.453-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:36:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:36:58.720-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:36:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:37:29.014-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:37:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:37:59.168-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:37:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:38:29.456-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:38:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:38:59.634-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:38:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:39:29.951-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:39:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:40:00.139-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:39:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:40:30.497-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:40:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:41:00.764-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:41:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:41:30.924-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:41:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:42:01.228-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:42:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:42:31.497-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:42:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:43:01.757-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:43:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:43:32.061-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:43:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:44:02.300-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:44:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:44:32.599-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:44:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:45:02.889-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:45:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:45:33.151-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:45:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:46:03.461-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:46:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:46:33.787-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:46:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:47:03.959-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:47:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:47:34.238-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:47:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:48:04.513-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:48:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:48:34.898-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:48:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:49:05.177-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:49:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:49:35.467-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:49:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:50:05.755-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:50:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:50:36.004-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:50:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:51:06.267-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:51:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:51:36.558-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:51:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:52:06.843-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:52:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:52:37.138-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:52:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:53:07.523-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:53:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:53:37.799-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:53:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:54:08.026-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:54:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:54:38.309-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:54:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:55:08.582-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:55:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:55:38.855-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:55:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:56:09.139-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:56:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:56:39.285-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:56:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:57:09.581-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:57:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:57:39.908-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:57:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:58:10.215-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:58:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:58:40.483-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:58:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:59:10.742-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:59:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T21:59:41.015-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 21:59:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:00:11.297-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:00:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:00:41.563-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:00:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:01:11.862-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:01:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:01:42.127-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:01:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:02:12.393-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:02:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:02:42.562-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:02:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:03:12.792-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:03:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:03:43.137-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:03:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:04:13.396-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:04:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:04:43.718-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:04:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:05:13.997-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:05:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:05:44.201-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:05:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:06:14.491-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:06:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:06:44.773-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:06:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:07:15.237-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:07:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:07:45.687-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:07:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:08:15.874-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:08:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:08:46.113-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:08:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:09:16.376-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:09:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:09:46.649-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:09:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:10:16.973-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:10:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:10:47.258-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:10:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:11:17.540-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:11:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:11:47.802-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:11:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:12:18.180-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:12:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:12:48.378-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:12:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:13:18.755-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:13:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:13:49.221-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:13:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:14:19.652-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:14:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:14:49.981-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:14:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:15:20.161-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:15:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:15:50.478-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:15:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:16:20.794-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:16:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:16:51.053-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:16:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:17:21.320-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:17:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:17:51.626-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:17:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:18:22.003-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:18:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:18:52.299-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:18:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:19:22.438-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:19:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:19:52.736-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:19:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:20:23.035-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:20:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:20:53.270-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:20:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:21:23.467-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:21:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:21:53.622-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:21:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:22:23.822-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:22:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:22:53.969-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:22:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:23:24.258-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:23:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:23:54.551-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:23:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:24:24.858-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:24:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:24:55.125-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:24:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:25:25.291-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:25:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:25:55.505-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:25:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:26:05.948-0500 [conn16] authenticate db: historyDb { authenticate: 1, user: "its_rw", nonce: "xxx", key: "xxx" } 2017-01-25T22:26:25.782-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:26:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:26:56.064-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:26:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:27:26.346-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:27:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:27:56.709-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:27:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:28:26.985-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:28:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:28:57.277-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:28:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:29:27.467-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:29:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:29:57.733-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:29:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:30:28.024-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:30:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:30:58.285-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:30:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:31:28.561-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:31:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:31:58.929-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:31:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:32:29.205-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:32:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:32:59.361-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:32:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:33:29.686-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:33:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:33:59.859-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:33:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:34:30.141-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:34:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:35:00.332-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:35:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:35:30.603-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:35:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:36:00.875-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:36:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:36:31.175-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:36:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:37:01.430-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:37:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:37:31.712-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:37:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:38:01.969-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:38:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:38:32.331-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:38:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:39:02.593-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:39:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:39:32.840-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:39:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:40:03.203-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:40:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:40:33.489-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:40:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:41:03.648-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:41:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:41:33.795-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:41:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:42:04.143-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:42:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:42:34.407-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:42:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:43:04.592-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:43:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:43:34.875-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:43:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:44:05.045-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:44:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:44:35.349-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:44:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:45:05.485-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:45:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:45:35.804-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:45:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:46:06.155-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:46:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:46:36.310-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:46:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:47:06.505-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:47:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:47:36.766-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:47:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:48:07.031-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:48:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:48:37.378-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:48:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:49:07.684-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:49:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:49:38.014-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:49:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:50:08.156-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:50:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:50:38.541-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:50:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:51:08.813-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:51:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:51:39.132-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:51:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:52:09.435-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:52:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:52:39.816-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:52:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:53:10.118-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:53:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:53:40.402-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:53:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:54:10.772-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:54:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:54:40.991-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:54:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:55:11.266-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:55:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:55:41.429-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:55:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:56:11.696-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:56:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:56:41.967-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:56:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:57:12.361-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:57:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:57:42.657-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:57:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:58:12.867-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:58:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:58:43.160-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:58:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:59:13.731-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:59:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T22:59:43.887-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 22:59:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:00:14.030-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:00:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:00:44.411-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:00:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:01:14.698-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:01:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:01:44.905-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:01:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:02:15.179-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:02:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:02:45.495-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:02:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:03:15.830-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:03:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:03:46.120-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:03:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:04:16.416-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:04:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:04:46.601-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:04:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:05:16.895-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:05:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:05:47.265-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:05:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:06:17.555-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:06:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:06:47.803-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:06:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:07:18.078-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:07:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:07:48.378-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:07:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:08:18.813-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:08:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:08:49.021-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:08:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:09:19.304-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:09:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:09:49.495-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:09:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:10:19.767-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:10:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:10:50.069-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:10:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:11:20.300-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:11:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:11:50.558-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:11:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:12:20.871-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:12:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:12:51.054-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:12:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:13:21.385-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:13:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:13:51.635-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:13:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:14:21.828-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:14:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:14:52.109-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:14:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:15:22.509-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:15:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:15:52.795-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:15:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:16:23.241-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:16:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:16:53.528-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:16:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:17:23.797-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:17:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:17:54.082-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:17:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:18:24.216-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:18:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:18:54.511-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:18:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:19:24.796-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:19:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:19:55.085-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:19:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:20:25.236-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:20:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:20:55.533-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:20:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:21:25.855-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:21:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:21:56.175-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:21:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:22:26.420-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:22:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:22:56.730-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:22:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:23:27.145-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:23:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:23:57.499-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:23:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:24:27.766-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:24:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:24:57.946-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:24:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:25:28.238-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:25:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:25:58.525-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:25:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:26:28.899-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:26:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:26:59.193-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:26:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:27:29.617-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:27:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:27:59.787-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:27:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:28:30.067-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:28:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:29:00.387-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:29:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:29:30.539-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:29:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:30:00.782-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:30:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:30:30.960-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:30:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:31:01.239-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:31:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:31:31.445-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:31:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:32:01.623-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:32:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:32:31.908-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:32:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:33:02.273-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:33:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:33:32.528-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:33:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:34:02.784-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:34:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:34:33.052-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:34:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:35:03.324-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:35:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:35:33.620-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:35:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:36:03.882-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:36:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:36:34.181-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:36:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:37:04.473-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:37:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:37:34.694-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:37:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:38:04.970-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:38:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:38:35.272-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:38:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:39:05.466-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:39:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:39:35.737-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:39:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:40:06.098-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:40:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:40:36.266-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:40:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:41:06.426-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:41:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:41:36.705-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:41:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:42:06.979-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:42:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:42:37.257-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:42:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:43:07.524-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:43:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:43:37.764-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:43:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:44:08.028-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:44:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:44:38.415-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:44:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:45:08.690-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:45:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:45:38.904-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:45:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:46:09.230-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:46:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:46:39.379-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:46:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:47:09.801-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:47:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:47:40.181-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:47:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:48:10.464-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:48:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:48:40.747-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:48:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:49:11.078-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:49:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:49:41.235-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:49:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:50:11.566-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:50:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:50:42.249-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:50:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:51:12.541-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:51:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:51:42.828-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:51:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:52:13.116-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:52:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:52:43.312-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:52:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:53:13.616-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:53:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:53:43.757-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:53:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:54:14.025-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:54:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:54:44.316-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:54:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:55:14.614-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:55:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:55:45.012-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:55:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:56:15.352-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:56:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:56:45.515-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:56:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:57:15.895-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:57:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:57:46.163-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:57:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:58:16.481-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:58:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:58:46.686-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:58:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:59:17.039-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:59:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-25T23:59:47.325-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Wed Jan 25 23:59:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:00:17.667-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:00:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:00:47.957-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:00:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:00:53.799-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588982859527cdec667c10a4 2017-01-26T00:00:54.344-0500 [Balancer] ChunkManager: time to load chunks for historyDb.History: 117ms sequenceNumber: 8 version: 3285|21||55c0dbaf5b591f0b0cfcee5f based on: 3285|19||55c0dbaf5b591f0b0cfcee5f 2017-01-26T00:00:54.543-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T00:01:18.329-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:01:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:01:37.308-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:01:37.308-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:01:48.596-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:01:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:01:50.024-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588982bd9527cdec667c10a6 2017-01-26T00:01:50.725-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T00:02:18.907-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:02:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:02:49.248-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:02:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:03:15.704-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:03:15.704-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:03:19.425-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:03:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:03:22.024-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:03:22.024-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:03:34.239-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:03:34.239-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:03:46.559-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588983329527cdec667c10aa 2017-01-26T00:03:47.276-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T00:03:49.821-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:03:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:03:59.706-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5889833f9527cdec667c10ab 2017-01-26T00:04:00.410-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T00:04:20.159-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:04:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:04:30.941-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:04:30.941-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:04:37.322-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588983659527cdec667c10ad 2017-01-26T00:04:38.032-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T00:04:50.397-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:04:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:05:14.696-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('58898389c44c904d7fe09556') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485407114558), why: "doing balance round", ts: ObjectId('5889838a9527cdec667c10ae') } } gle1: { lastOp: Timestamp 1485407077000|46, connectionId: 21778, updatedExisting: false, n: 0, syncMillis: 19, writtenTo: null, err: null, waited: 19, ok: 1.0 } gle2: { lastOp: Timestamp 1485407114000|36, connectionId: 6379656, updatedExisting: true, n: 1, syncMillis: 13, writtenTo: null, err: null, waited: 13, ok: 1.0 } 2017-01-26T00:05:14.702-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-26T00:05:14.702-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:05:20.732-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:05:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:05:20.732-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-26T00:05:20.876-0500 [LockPinger] handled late remove of old distributed lock with ts 5889838a9527cdec667c10ae 2017-01-26T00:05:21.026-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588983909527cdec667c10af 2017-01-26T00:05:21.664-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T00:05:27.963-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588983979527cdec667c10b0 2017-01-26T00:05:28.747-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T00:05:51.161-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:05:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:05:53.405-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588983b19527cdec667c10b1 2017-01-26T00:05:54.070-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T00:06:21.490-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:06:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:06:24.543-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:06:24.543-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:06:51.899-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:06:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:07:07.155-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:07:07.155-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:07:19.587-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:07:19.588-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:07:22.185-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:07:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:07:38.053-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:07:38.053-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:07:52.541-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:07:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:08:22.831-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:08:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:08:45.105-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:08:45.105-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:08:53.089-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:08:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:09:23.322-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:09:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:09:33.757-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('5889848c1bf20458cb7b4f87') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485407373638), why: "doing balance round", ts: ObjectId('5889848d9527cdec667c10b7') } } gle1: { lastOp: Timestamp 1485407373000|26, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 9, writtenTo: null, err: null, waited: 9, ok: 1.0 } gle2: { lastOp: Timestamp 1485407153000|33, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 2, writtenTo: null, err: null, waited: 2, ok: 1.0 } 2017-01-26T00:09:33.767-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-26T00:09:33.911-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5889848d9527cdec667c10b7 2017-01-26T00:09:34.577-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T00:09:46.856-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:09:46.856-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:09:53.465-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:09:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:09:59.149-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:09:59.149-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:10:17.506-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:10:17.506-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:10:23.806-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:10:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:10:24.020-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588984bf9527cdec667c10bb 2017-01-26T00:10:24.688-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T00:10:54.097-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:10:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:11:24.444-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:11:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:11:38.157-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588985099527cdec667c10bc 2017-01-26T00:11:38.894-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T00:11:54.735-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:11:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:12:21.511-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('58898534134c6c54b42651b6') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485407541372), why: "doing balance round", ts: ObjectId('588985359527cdec667c10bd') } } gle1: { lastOp: Timestamp 1485407498000|26, connectionId: 21778, updatedExisting: false, n: 0, syncMillis: 32, writtenTo: null, err: null, waited: 32, ok: 1.0 } gle2: { lastOp: Timestamp 1485407541000|19, connectionId: 6379656, updatedExisting: true, n: 1, syncMillis: 22, writtenTo: null, err: null, waited: 22, ok: 1.0 } 2017-01-26T00:12:21.520-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-26T00:12:21.520-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:12:24.979-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:12:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:12:24.979-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-26T00:12:25.123-0500 [LockPinger] handled late remove of old distributed lock with ts 588985359527cdec667c10bd 2017-01-26T00:12:27.836-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:12:27.836-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:12:34.018-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:12:34.018-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:12:55.473-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:12:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:13:25.781-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:13:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:13:56.075-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:13:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:14:26.345-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:14:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:14:35.785-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588985bb9527cdec667c10c0 2017-01-26T00:14:36.493-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T00:14:48.950-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588985c89527cdec667c10c1 2017-01-26T00:14:49.516-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T00:14:56.513-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:14:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:15:26.213-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588985ee9527cdec667c10c2 2017-01-26T00:15:26.851-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:15:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:15:26.993-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T00:15:57.045-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:15:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:16:27.311-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:16:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:16:46.020-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:16:46.020-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:16:57.531-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:16:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:17:27.828-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:17:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:17:34.895-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:17:34.895-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:17:53.437-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:17:53.437-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:17:58.232-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:17:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:18:28.510-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:18:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:18:35.996-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588986ab25b993100ac7fd5f') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485407915918), why: "doing balance round", ts: ObjectId('588986ab9527cdec667c10c6') } } gle1: { lastOp: Timestamp 1485407915000|50, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 5, writtenTo: null, err: null, waited: 5, ok: 1.0 } gle2: { lastOp: Timestamp 1485407726000|27, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 5, writtenTo: null, err: null, waited: 5, ok: 1.0 } 2017-01-26T00:18:36.004-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-26T00:18:36.140-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588986ab9527cdec667c10c6 2017-01-26T00:18:36.820-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T00:18:58.849-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:18:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:19:25.529-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:19:25.529-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:19:29.124-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:19:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:19:37.818-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:19:37.818-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:19:56.225-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:19:56.225-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:19:59.408-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:19:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:20:26.860-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5889871a9527cdec667c10ca 2017-01-26T00:20:27.536-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T00:20:29.749-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:20:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:20:39.913-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588987279527cdec667c10cb 2017-01-26T00:20:40.576-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T00:21:00.037-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:20:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:21:05.106-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588987409527cdec667c10cc 2017-01-26T00:21:05.710-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T00:21:30.292-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:21:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:22:00.627-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:22:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:22:12.844-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:22:12.844-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:22:19.108-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:22:19.108-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:22:31.044-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:22:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:22:31.402-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:22:31.402-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:23:01.250-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:23:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:23:31.558-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:23:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:23:44.387-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:23:44.387-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:24:01.811-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:24:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:24:32.018-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:24:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:24:39.395-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:24:39.395-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:25:02.284-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:25:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:25:32.588-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:25:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:26:02.890-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:26:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:26:10.883-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588988729527cdec667c10d2 2017-01-26T00:26:11.627-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T00:26:33.224-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:26:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:27:03.513-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:27:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:27:33.781-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:27:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:27:36.866-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:27:36.866-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:28:04.144-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:28:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:28:07.494-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588988e79527cdec667c10d4 2017-01-26T00:28:08.128-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T00:28:34.520-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:28:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:28:50.891-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:28:50.891-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:29:04.900-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:29:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:29:35.251-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:29:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:29:45.793-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:29:45.793-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:29:52.017-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:29:52.017-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:30:05.575-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:30:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:30:34.951-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:30:34.951-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:30:35.879-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:30:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:31:06.310-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:31:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:31:11.701-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5889899f9527cdec667c10d9 2017-01-26T00:31:12.310-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T00:31:36.602-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:31:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:32:06.906-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:32:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:32:25.619-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:32:25.619-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:32:37.232-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:32:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:32:44.137-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588989fb9527cdec667c10db 2017-01-26T00:32:45.093-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T00:33:07.377-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:33:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:33:21.765-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58898a219527cdec667c10dc 2017-01-26T00:33:22.375-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T00:33:37.714-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:33:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:33:52.904-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:33:52.904-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:34:07.940-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:34:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:34:38.238-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:34:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:35:08.403-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:35:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:35:30.373-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58898aa29527cdec667c10de 2017-01-26T00:35:31.010-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T00:35:38.787-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:35:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:36:07.796-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:36:07.796-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:36:09.113-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:36:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:36:14.175-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58898acd9527cdec667c10e0 2017-01-26T00:36:14.803-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T00:36:39.411-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:36:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:36:51.629-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58898af39527cdec667c10e1 2017-01-26T00:36:52.516-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T00:37:04.999-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58898b009527cdec667c10e2 2017-01-26T00:37:05.772-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T00:37:09.689-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:37:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:37:39.995-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:37:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:38:06.630-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:38:06.630-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:38:10.325-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:38:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:38:37.135-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:38:37.135-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:38:40.622-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:38:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:39:10.810-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:39:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:39:38.308-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58898b9a9527cdec667c10e5 2017-01-26T00:39:39.005-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T00:39:41.063-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:39:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:39:57.433-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58898bad9527cdec667c10e6 2017-01-26T00:39:58.133-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T00:40:11.380-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:40:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:40:16.577-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58898bc09527cdec667c10e7 2017-01-26T00:40:17.290-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T00:40:29.571-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:40:29.571-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:40:35.988-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58898bd39527cdec667c10e9 2017-01-26T00:40:36.552-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T00:40:41.669-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:40:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:41:01.069-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('58898bec331a0d8ab511d166') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485409260977), why: "doing balance round", ts: ObjectId('58898bec9527cdec667c10ea') } } gle1: { lastOp: Timestamp 1485409261000|3, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 3, writtenTo: null, err: null, waited: 3, ok: 1.0 } gle2: { lastOp: Timestamp 1485409236000|25, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 19, writtenTo: null, err: null, waited: 19, ok: 1.0 } 2017-01-26T00:41:01.076-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-26T00:41:01.076-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:41:12.159-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:41:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:41:12.159-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-26T00:41:12.314-0500 [LockPinger] handled late remove of old distributed lock with ts 58898bec9527cdec667c10ea 2017-01-26T00:41:13.287-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:41:13.288-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:41:42.607-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:41:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:42:12.981-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:42:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:42:20.378-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:42:20.378-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:42:43.220-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:42:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:43:13.528-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:43:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:43:27.554-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:43:27.554-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:43:43.815-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:43:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:43:52.104-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:43:52.104-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:43:58.310-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:43:58.310-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:44:14.128-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:44:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:44:40.983-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:44:40.983-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:44:44.450-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:44:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:44:53.305-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:44:53.305-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:45:14.631-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:45:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:45:45.038-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:45:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:46:12.618-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58898d249527cdec667c10f2 2017-01-26T00:46:13.255-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T00:46:15.249-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:46:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:46:37.721-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:46:37.721-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:46:45.507-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:46:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:46:49.970-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:46:49.970-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:47:02.440-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('58898d557d1747595837ebde') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485409622306), why: "doing balance round", ts: ObjectId('58898d569527cdec667c10f5') } } gle1: { lastOp: Timestamp 1485409622000|12, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 18, writtenTo: null, err: null, waited: 18, ok: 1.0 } gle2: { lastOp: Timestamp 1485409573000|7, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 15, writtenTo: null, err: null, waited: 15, ok: 1.0 } 2017-01-26T00:47:02.446-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-26T00:47:02.446-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:47:15.818-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:47:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:47:15.818-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-26T00:47:15.929-0500 [LockPinger] handled late remove of old distributed lock with ts 58898d569527cdec667c10f5 2017-01-26T00:47:20.906-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:47:20.906-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:47:46.224-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:47:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:48:16.511-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:48:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:48:46.717-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:48:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:49:16.991-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:49:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:49:40.789-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:49:40.789-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:49:47.265-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:49:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:50:17.530-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:50:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:50:47.737-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:50:47.738-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:50:47.770-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:50:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:51:18.045-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:51:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:51:24.401-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:51:24.401-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:51:48.290-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:51:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:52:07.055-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:52:07.055-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:52:18.629-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:52:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:52:43.877-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58898eab9527cdec667c10fb 2017-01-26T00:52:44.619-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T00:52:48.899-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:52:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:53:03.025-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58898ebe9527cdec667c10fc 2017-01-26T00:53:03.879-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T00:53:19.043-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:53:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:53:49.323-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:53:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:54:19.663-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:54:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:54:50.106-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:54:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:55:20.365-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:55:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:55:50.686-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:55:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:55:54.336-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T00:55:54.336-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T00:56:21.061-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:56:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:56:51.347-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:56:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:57:19.409-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58898fbf9527cdec667c10fe 2017-01-26T00:57:20.083-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T00:57:21.636-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:57:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:57:38.628-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58898fd29527cdec667c10ff 2017-01-26T00:57:39.352-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T00:57:51.904-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:57:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:58:22.109-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:58:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:58:34.293-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5889900a9527cdec667c1100 2017-01-26T00:58:34.941-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T00:58:52.359-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:58:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:59:17.663-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588990359527cdec667c1101 2017-01-26T00:59:18.345-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T00:59:22.650-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:59:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T00:59:52.870-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 00:59:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:00:23.264-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:00:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:00:25.472-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:00:25.473-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:00:31.713-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:00:31.713-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:00:53.559-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:00:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:01:08.308-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:01:08.308-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:01:14.523-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:01:14.523-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:01:23.863-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:01:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:01:26.815-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:01:26.816-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:01:54.158-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:01:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:02:24.381-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:02:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:02:27.659-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:02:27.659-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:02:54.697-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:02:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:03:24.932-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:03:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:03:55.204-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:03:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:04:25.584-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:04:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:04:41.398-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:04:41.398-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:04:55.862-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:04:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:05:26.183-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:05:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:05:48.352-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:05:48.352-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:05:56.328-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:05:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:06:00.646-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:06:00.646-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:06:19.094-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588991da9527cdec667c110b 2017-01-26T01:06:19.688-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T01:06:26.595-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:06:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:06:56.879-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:06:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:07:20.736-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:07:20.736-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:07:27.138-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:07:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:07:33.169-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588992249527cdec667c110d 2017-01-26T01:07:33.889-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T01:07:57.431-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:07:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:08:04.349-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:08:04.349-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:08:16.627-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:08:16.628-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:08:27.842-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:08:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:08:58.105-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:08:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:09:28.278-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:09:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:09:35.808-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:09:35.808-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:09:48.115-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:09:48.115-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:09:54.661-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588992b29527cdec667c1112 2017-01-26T01:09:55.371-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T01:09:58.559-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:09:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:10:28.807-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:10:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:10:50.118-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:10:50.119-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:10:59.110-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:10:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:11:29.414-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:11:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:11:38.824-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:11:38.824-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:11:59.701-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:11:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:12:15.647-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5889933f9527cdec667c1115 2017-01-26T01:12:16.177-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T01:12:29.991-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:12:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:12:58.980-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:12:58.980-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:13:00.392-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:12:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:13:11.449-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:13:11.449-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:13:29.953-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588993899527cdec667c1118 2017-01-26T01:13:30.587-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T01:13:30.737-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:13:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:13:49.037-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5889939c9527cdec667c1119 2017-01-26T01:13:49.627-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T01:14:00.976-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:14:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:14:14.172-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588993b59527cdec667c111a 2017-01-26T01:14:14.873-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T01:14:31.245-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:14:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:14:45.407-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:14:45.408-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:14:57.822-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588993e19527cdec667c111c 2017-01-26T01:14:58.535-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T01:15:01.398-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:15:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:15:04.928-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588993e89527cdec667c111d 2017-01-26T01:15:05.593-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T01:15:11.944-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:15:11.944-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:15:31.831-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:15:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:16:02.035-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:16:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:16:06.731-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:16:06.731-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:16:25.082-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:16:25.082-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:16:32.284-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:16:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:16:49.626-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('58899450ee2ebe2ebd3cdedd') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485411409470), why: "doing balance round", ts: ObjectId('588994519527cdec667c1121') } } gle1: { lastOp: Timestamp 1485411409000|18, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 32, writtenTo: null, err: null, waited: 32, ok: 1.0 } gle2: { lastOp: Timestamp 1485411305000|12, connectionId: 393608, updatedExisting: false, n: 0, syncMillis: 3, writtenTo: null, err: null, waited: 3, ok: 1.0 } 2017-01-26T01:16:49.636-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-26T01:16:49.771-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588994519527cdec667c1121 2017-01-26T01:16:50.479-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T01:17:02.572-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:17:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:17:14.977-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:17:14.978-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:17:32.812-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:17:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:18:03.143-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:18:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:18:33.376-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:18:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:19:03.701-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:19:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:19:33.980-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:19:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:20:04.234-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:20:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:20:34.558-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:20:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:20:47.511-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:20:47.511-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:21:04.813-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:21:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:21:24.047-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:21:24.047-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:21:35.203-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:21:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:21:42.336-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:21:42.337-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:21:48.570-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:21:48.571-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:21:54.731-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:21:54.731-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:22:05.421-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:22:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:22:35.794-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:22:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:22:37.446-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588995ad9527cdec667c1128 2017-01-26T01:22:38.084-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T01:22:44.436-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588995b49527cdec667c1129 2017-01-26T01:22:45.144-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T01:23:06.060-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:23:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:23:15.766-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:23:15.766-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:23:28.094-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:23:28.094-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:23:36.353-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:23:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:23:40.328-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:23:40.328-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:23:58.715-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:23:58.715-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:24:04.977-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:24:04.977-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:24:06.643-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:24:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:24:17.297-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:24:17.297-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:24:37.059-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:24:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:24:59.972-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:24:59.972-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:25:06.195-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:25:06.195-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:25:07.399-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:25:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:25:37.786-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:25:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:25:42.783-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:25:42.783-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:26:07.994-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:26:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:26:37.632-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:26:37.632-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:26:38.239-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:26:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:26:43.819-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:26:43.819-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:27:08.523-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:27:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:27:32.744-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:27:32.744-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:27:38.800-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:27:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:28:03.400-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588996f39527cdec667c1136 2017-01-26T01:28:04.056-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T01:28:09.083-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:28:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:28:10.504-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588996fa9527cdec667c1137 2017-01-26T01:28:11.207-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T01:28:23.441-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:28:23.441-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:28:29.813-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5889970d9527cdec667c1139 2017-01-26T01:28:30.556-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T01:28:39.365-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:28:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:29:09.650-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:29:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:29:19.434-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:29:19.434-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:29:39.926-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:29:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:30:08.260-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:30:08.260-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:30:10.216-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:30:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:30:40.573-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:30:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:31:09.024-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:31:09.024-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:31:10.836-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:31:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:31:41.160-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:31:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:32:11.450-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:32:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:32:15.949-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:32:15.949-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:32:22.160-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:32:22.160-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:32:28.325-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:32:28.325-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:32:40.556-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:32:40.556-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:32:41.688-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:32:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:32:52.978-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588998149527cdec667c1141 2017-01-26T01:32:53.573-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T01:33:11.996-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:33:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:33:18.061-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:33:18.061-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:33:42.345-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:33:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:34:12.618-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:34:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:34:24.970-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('58899870364dd086a1b3598c') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485412464821), why: "doing balance round", ts: ObjectId('588998709527cdec667c1143') } } gle1: { lastOp: Timestamp 1485412464000|31, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 15, writtenTo: null, err: null, waited: 15, ok: 1.0 } gle2: { lastOp: Timestamp 1485412373000|18, connectionId: 393608, updatedExisting: false, n: 0, syncMillis: 26, writtenTo: null, err: null, waited: 26, ok: 1.0 } 2017-01-26T01:34:24.981-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-26T01:34:25.152-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588998709527cdec667c1143 2017-01-26T01:34:25.859-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T01:34:42.910-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:34:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:35:13.186-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:35:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:35:38.880-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:35:38.880-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:35:43.542-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:35:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:35:45.104-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:35:45.104-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:36:03.502-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:36:03.502-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:36:09.704-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:36:09.704-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:36:13.885-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:36:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:36:40.574-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:36:40.574-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:36:44.170-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:36:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:37:05.243-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588999109527cdec667c1149 2017-01-26T01:37:05.907-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T01:37:14.446-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:37:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:37:18.435-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5889991e9527cdec667c114a 2017-01-26T01:37:19.105-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T01:37:31.522-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 5889992b9527cdec667c114b 2017-01-26T01:37:32.248-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T01:37:44.729-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:37:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:37:56.649-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:37:56.649-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:38:15.017-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:38:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:38:27.124-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:38:27.124-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:38:39.345-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:38:39.345-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:38:45.247-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:38:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:38:45.571-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:38:45.571-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:38:57.840-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:38:57.841-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:39:15.394-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:39:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:39:16.134-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:39:16.134-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:39:28.410-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:39:28.410-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:39:45.631-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:39:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:39:46.776-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:39:46.776-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:40:15.923-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:40:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:40:29.379-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:40:29.379-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:40:46.202-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:40:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:41:06.071-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:41:06.072-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:41:16.413-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:41:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:41:46.821-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:41:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:41:55.111-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58899a329527cdec667c1156 2017-01-26T01:41:55.718-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T01:42:08.000-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:42:08.000-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:42:17.119-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:42:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:42:20.274-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:42:20.274-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:42:47.274-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:42:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:43:17.619-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:43:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:43:21.212-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:43:21.212-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:43:47.832-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:43:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:44:18.039-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:44:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:44:28.062-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:44:28.062-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:44:40.352-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:44:40.352-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:44:48.349-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:44:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:44:58.750-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:44:58.750-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:45:18.637-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:45:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:45:48.825-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:45:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:45:59.606-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:45:59.606-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:46:05.829-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:46:05.829-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:46:19.209-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:46:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:46:30.266-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:46:30.266-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:46:49.485-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:46:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:47:00.765-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:47:00.765-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:47:19.712-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:47:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:47:37.457-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:47:37.457-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:47:49.966-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:47:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:48:20.149-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:48:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:48:38.461-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58899bc69527cdec667c1162 2017-01-26T01:48:39.209-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T01:48:45.574-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58899bcd9527cdec667c1163 2017-01-26T01:48:46.289-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T01:48:50.442-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:48:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:49:20.656-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:49:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:49:34.994-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:49:34.995-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:49:41.207-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:49:41.207-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:49:51.005-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:49:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:50:18.045-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58899c299527cdec667c1166 2017-01-26T01:50:18.712-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T01:50:21.286-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:50:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:50:51.554-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:50:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:51:01.271-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:51:01.271-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:51:21.808-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:51:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:51:52.105-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:51:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:51:56.186-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('58899c8b165b0f7efefff20b') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485413516021), why: "doing balance round", ts: ObjectId('58899c8c9527cdec667c1168') } } gle1: { lastOp: Timestamp 1485413418000|16, connectionId: 21778, updatedExisting: false, n: 0, syncMillis: 7, writtenTo: null, err: null, waited: 7, ok: 1.0 } gle2: { lastOp: Timestamp 1485413516000|2, connectionId: 6379656, updatedExisting: true, n: 1, syncMillis: 28, writtenTo: null, err: null, waited: 28, ok: 1.0 } 2017-01-26T01:51:56.196-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-26T01:51:56.369-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58899c8c9527cdec667c1168 2017-01-26T01:51:57.073-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T01:52:09.487-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58899c999527cdec667c1169 2017-01-26T01:52:10.081-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T01:52:22.386-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:52:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:52:52.694-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:52:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:53:04.997-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:53:04.997-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:53:23.007-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:53:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:53:53.309-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:53:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:54:12.243-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58899d139527cdec667c116b 2017-01-26T01:54:12.944-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T01:54:23.625-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:54:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:54:54.099-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:54:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:55:14.164-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:55:14.164-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:55:24.360-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:55:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:55:54.781-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:55:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:56:25.096-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:56:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:56:33.323-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:56:33.324-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:56:55.293-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:56:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:57:03.883-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:57:03.883-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:57:25.575-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:57:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:57:52.641-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:57:52.641-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:57:55.745-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:57:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:58:23.129-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:58:23.130-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:58:26.100-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:58:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:58:35.410-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:58:35.411-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:58:53.698-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:58:53.698-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:58:56.307-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:58:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:59:12.079-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-26T01:59:12.079-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-26T01:59:26.449-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:59:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:59:48.962-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58899e649527cdec667c1174 2017-01-26T01:59:49.696-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T01:59:56.033-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 58899e6b9527cdec667c1175 2017-01-26T01:59:56.742-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 01:59:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T01:59:56.742-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-26T02:00:27.027-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:00:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:00:57.345-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:00:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:01:27.567-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:01:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:01:57.977-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:01:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:02:28.207-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:02:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:02:58.541-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:02:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:03:28.870-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:03:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:03:59.098-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:03:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:04:29.375-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:04:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:04:59.769-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:04:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:05:30.052-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:05:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:06:00.402-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:06:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:06:30.774-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:06:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:07:01.040-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:07:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:07:31.280-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:07:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:08:01.588-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:08:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:08:31.881-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:08:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:09:02.257-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:09:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:09:32.426-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:09:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:10:02.730-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:10:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:10:33.009-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:10:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:11:03.424-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:11:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:11:33.621-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:11:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:12:03.909-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:12:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:12:34.194-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:12:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:13:04.476-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:13:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:13:34.781-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:13:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:14:05.051-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:14:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:14:35.334-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:14:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:15:05.488-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:15:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:15:35.718-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:15:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:16:06.062-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:16:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:16:36.325-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:16:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:17:06.459-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:17:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:17:36.809-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:17:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:18:07.077-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:18:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:18:37.433-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:18:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:19:07.715-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:19:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:19:37.995-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:19:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:20:08.275-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:20:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:20:38.543-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:20:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:21:08.807-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:21:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:21:39.094-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:21:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:22:09.285-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:22:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:22:39.624-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:22:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:23:09.888-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:23:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:23:40.254-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:23:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:24:10.461-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:24:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:24:40.754-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:24:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:25:11.096-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:25:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:25:41.383-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:25:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:26:11.691-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:26:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:26:41.958-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:26:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:27:12.270-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:27:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:27:42.618-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:27:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:28:12.921-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:28:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:28:43.182-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:28:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:29:13.466-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:29:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:29:43.839-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:29:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:30:14.174-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:30:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:30:44.483-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:30:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:31:14.807-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:31:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:31:44.989-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:31:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:32:15.275-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:32:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:32:45.581-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:32:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:33:15.809-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:33:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:33:46.098-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:33:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:34:16.388-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:34:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:34:46.811-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:34:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:35:17.096-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:35:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:35:47.369-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:35:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:36:17.656-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:36:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:36:47.911-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:36:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:37:18.212-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:37:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:37:48.508-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:37:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:38:18.841-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:38:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:38:49.043-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:38:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:39:19.359-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:39:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:39:49.603-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:39:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:40:19.764-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:40:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:40:50.063-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:40:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:41:20.485-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:41:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:41:50.763-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:41:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:42:21.048-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:42:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:42:51.238-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:42:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:43:21.541-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:43:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:43:51.901-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:43:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:44:22.168-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:44:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:44:52.451-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:44:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:45:22.709-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:45:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:45:53.104-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:45:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:46:23.379-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:46:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:46:53.794-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:46:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:47:24.375-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:47:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:47:54.647-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:47:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:48:24.925-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:48:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:48:55.312-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:48:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:49:25.607-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:49:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:49:55.902-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:49:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:50:26.186-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:50:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:50:56.407-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:50:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:51:26.678-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:51:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:51:57.010-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:51:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:52:27.249-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:52:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:52:57.515-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:52:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:53:27.793-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:53:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:53:58.076-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:53:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:54:28.545-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:54:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:54:58.855-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:54:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:55:29.150-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:55:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:55:59.327-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:55:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:56:29.612-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:56:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:57:00.013-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:56:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:57:30.318-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:57:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:58:00.593-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:58:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:58:30.865-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:58:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:59:01.085-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:59:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T02:59:31.442-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 02:59:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:00:01.719-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:00:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:00:32.124-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:00:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:01:03.001-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:01:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:01:33.293-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:01:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:02:03.593-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:02:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:02:33.896-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:02:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:03:04.285-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:03:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:03:34.439-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:03:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:04:04.722-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:04:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:04:34.971-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:04:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:05:05.324-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:05:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:05:35.557-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:05:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:06:05.714-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:06:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:06:36.013-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:06:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:07:06.344-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:07:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:07:36.634-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:07:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:08:06.893-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:08:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:08:37.296-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:08:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:09:07.581-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:09:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:09:37.809-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:09:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:10:08.088-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:10:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:10:38.368-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:10:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:11:08.650-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:11:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:11:38.944-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:11:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:12:09.156-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:12:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:12:39.453-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:12:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:13:09.747-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:13:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:13:39.936-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:13:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:14:10.220-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:14:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:14:40.541-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:14:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:15:10.787-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:15:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:15:40.968-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:15:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:16:11.177-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:16:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:16:41.461-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:16:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:17:11.662-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:17:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:17:41.988-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:17:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:18:12.275-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:18:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:18:42.560-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:18:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:19:12.836-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:19:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:19:43.057-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:19:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:20:13.346-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:20:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:20:43.619-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:20:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:21:13.936-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:21:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:21:44.217-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:21:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:22:14.498-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:22:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:22:44.776-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:22:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:23:14.920-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:23:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:23:45.222-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:23:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:24:15.498-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:24:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:24:45.663-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:24:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:25:15.930-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:25:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:25:46.102-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:25:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:26:16.370-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:26:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:26:46.734-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:26:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:27:16.877-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:27:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:27:47.088-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:27:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:28:17.224-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:28:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:28:47.479-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:28:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:29:17.769-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:29:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:29:48.195-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:29:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:30:18.449-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:30:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:30:48.754-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:30:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:31:19.155-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:31:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:31:49.578-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:31:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:32:19.865-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:32:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:32:50.163-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:32:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:33:20.416-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:33:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:33:50.689-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:33:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:34:20.937-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:34:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:34:51.132-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:34:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:35:21.449-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:35:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:35:51.739-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:35:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:36:22.022-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:36:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:36:52.316-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:36:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:37:22.611-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:37:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:37:52.894-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:37:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:38:23.272-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:38:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:38:53.450-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:38:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:39:23.771-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:39:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:39:54.117-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:39:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:40:24.422-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:40:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:40:54.761-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:40:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:41:24.928-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:41:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:41:55.079-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:41:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:42:25.225-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:42:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:42:55.521-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:42:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:43:25.765-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:43:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:43:55.953-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:43:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:44:26.318-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:44:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:44:56.642-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:44:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:45:26.787-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:45:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:45:57.071-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:45:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:46:27.446-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:46:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:46:57.644-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:46:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:47:27.959-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:47:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:47:58.381-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:47:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:48:28.647-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:48:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:48:58.937-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:48:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:49:29.321-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:49:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:49:59.594-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:49:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:50:29.841-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:50:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:51:00.126-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:50:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:51:30.356-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:51:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:52:00.654-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:52:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:52:31.008-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:52:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:53:01.264-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:53:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:53:31.555-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:53:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:54:01.821-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:54:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:54:32.007-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:54:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:55:02.280-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:55:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:55:32.544-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:55:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:56:02.821-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:56:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:56:33.106-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:56:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:57:03.387-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:57:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:57:33.669-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:57:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:58:03.975-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:58:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:58:34.240-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:58:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:59:04.502-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:59:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T03:59:34.848-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 03:59:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:00:05.133-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:00:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:00:35.399-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:00:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:01:05.678-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:01:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:01:35.857-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:01:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:02:06.138-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:02:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:02:36.316-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:02:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:03:06.483-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:03:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:03:36.765-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:03:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:04:07.103-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:04:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:04:37.385-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:04:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:05:07.571-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:05:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:05:37.864-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:05:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:06:08.244-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:06:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:06:38.512-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:06:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:07:08.709-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:07:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:07:39.068-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:07:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:08:09.355-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:08:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:08:39.774-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:08:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:09:10.112-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:09:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:09:40.417-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:09:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:10:10.625-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:10:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:10:40.892-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:10:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:11:11.089-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:11:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:11:41.398-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:11:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:12:11.773-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:12:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:12:42.059-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:12:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:13:12.320-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:13:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:13:42.605-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:13:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:14:12.862-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:14:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:14:43.327-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:14:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:15:13.594-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:15:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:15:43.833-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:15:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:16:14.099-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:16:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:16:44.400-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:16:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:17:14.881-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:17:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:17:45.170-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:17:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:18:15.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:18:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:18:45.662-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:18:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:19:15.803-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:19:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:19:46.087-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:19:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:20:16.229-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:20:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:20:46.595-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:20:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:21:16.879-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:21:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:21:47.374-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:21:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:22:17.691-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:22:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:22:47.896-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:22:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:23:18.095-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:23:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:23:48.341-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:23:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:24:18.620-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:24:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:24:48.892-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:24:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:25:19.046-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:25:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:25:49.197-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:25:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:26:19.439-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:26:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:26:49.606-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:26:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:27:19.868-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:27:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:27:50.145-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:27:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:28:20.425-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:28:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:28:50.579-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:28:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:29:20.852-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:29:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:29:51.240-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:29:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:30:20.338-0500 [conn17] authenticate db: historyDb { authenticate: 1, user: "its_rw", nonce: "xxx", key: "xxx" } 2017-01-26T04:30:21.557-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:30:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:30:51.964-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:30:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:31:22.132-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:31:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:31:52.327-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:31:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:32:22.541-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:32:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:32:52.869-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:32:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:33:23.126-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:33:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:33:53.276-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:33:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:34:23.627-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:34:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:34:53.897-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:34:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:35:24.171-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:35:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:35:54.439-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:35:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:36:24.766-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:36:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:36:54.912-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:36:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:37:25.197-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:37:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:37:55.612-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:37:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:38:25.902-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:38:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:38:56.201-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:38:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:39:26.564-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:39:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:39:56.829-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:39:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:40:27.071-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:40:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:40:57.488-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:40:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:41:27.764-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:41:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:41:58.218-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:41:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:42:28.507-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:42:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:42:58.797-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:42:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:43:29.063-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:43:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:43:59.218-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:43:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:44:29.509-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:44:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:44:59.681-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:44:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:45:30.001-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:45:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:46:00.185-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:46:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:46:30.362-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:46:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:47:00.638-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:47:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:47:31.009-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:47:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:48:01.294-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:48:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:48:31.721-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:48:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:49:01.976-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:49:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:49:32.260-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:49:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:50:02.574-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:50:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:50:32.841-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:50:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:51:03.109-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:51:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:51:33.489-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:51:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:52:03.704-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:52:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:52:33.860-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:52:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:53:04.134-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:53:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:53:34.420-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:53:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:54:04.713-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:54:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:54:35.010-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:54:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:55:05.256-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:55:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:55:35.556-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:55:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:56:05.849-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:56:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:56:36.123-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:56:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:57:06.401-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:57:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:57:36.692-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:57:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:58:06.963-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:58:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:58:37.279-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:58:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:59:07.428-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:59:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T04:59:37.707-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 04:59:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:00:07.961-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:00:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:00:38.238-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:00:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:01:08.493-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:01:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:01:38.750-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:01:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:02:08.948-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:02:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:02:39.220-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:02:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:03:09.378-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:03:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:03:39.634-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:03:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:04:09.905-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:04:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:04:40.358-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:04:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:05:10.636-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:05:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:05:40.851-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:05:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:06:11.140-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:06:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:06:41.438-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:06:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:07:11.727-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:07:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:07:42.011-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:07:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:08:12.297-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:08:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:08:42.526-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:08:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:09:12.903-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:09:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:09:43.072-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:09:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:10:13.342-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:10:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:10:43.575-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:10:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:11:13.855-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:11:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:11:44.135-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:11:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:12:14.520-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:12:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:12:44.902-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:12:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:13:15.165-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:13:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:13:45.363-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:13:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:14:15.662-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:14:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:14:45.940-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:14:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:15:16.255-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:15:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:15:46.467-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:15:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:16:16.808-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:16:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:16:47.151-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:16:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:17:17.288-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:17:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:17:47.521-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:17:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:18:17.813-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:18:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:18:47.980-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:18:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:19:18.412-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:19:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:19:48.615-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:19:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:20:18.914-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:20:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:20:49.110-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:20:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:21:19.383-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:21:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:21:49.665-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:21:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:22:19.933-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:22:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:22:50.232-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:22:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:23:20.511-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:23:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:23:50.867-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:23:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:24:21.020-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:24:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:24:51.206-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:24:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:25:21.497-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:25:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:25:51.764-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:25:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:26:22.039-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:26:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:26:52.323-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:26:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:27:22.695-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:27:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:27:53.064-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:27:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:28:23.338-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:28:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:28:53.707-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:28:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:29:23.991-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:29:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:29:54.391-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:29:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:30:24.596-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:30:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:30:54.981-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:30:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:31:25.357-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:31:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:31:55.487-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:31:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:32:25.636-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:32:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:32:55.828-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:32:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:33:26.110-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:33:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:33:56.400-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:33:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:34:26.749-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:34:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:34:57.030-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:34:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:35:27.293-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:35:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:35:57.541-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:35:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:36:27.809-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:36:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:36:58.079-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:36:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:37:28.420-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:37:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:37:58.720-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:37:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:38:29.001-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:38:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:38:59.285-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:38:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:39:29.566-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:39:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:39:59.840-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:39:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:40:30.116-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:40:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:41:00.386-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:41:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:41:30.722-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:41:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:42:01.163-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:42:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:42:31.331-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:42:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:43:01.734-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:43:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:43:32.021-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:43:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:44:02.359-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:44:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:44:32.627-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:44:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:45:02.925-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:45:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:45:33.281-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:45:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:46:03.423-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:46:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:46:33.736-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:46:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:47:04.011-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:47:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:47:34.315-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:47:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:48:04.530-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:48:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:48:34.805-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:48:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:49:05.088-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:49:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:49:35.381-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:49:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:50:05.628-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:50:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:50:35.833-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:50:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:51:06.193-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:51:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:51:36.470-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:51:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:52:06.731-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:52:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:52:37.077-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:52:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:53:07.366-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:53:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:53:37.633-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:53:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:54:07.856-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:54:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:54:37.993-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:54:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:55:08.265-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:55:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:55:38.648-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:55:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:56:08.929-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:56:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:56:39.088-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:56:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:57:09.364-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:57:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:57:39.655-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:57:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:58:09.925-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:58:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:58:40.227-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:58:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:59:10.571-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:59:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T05:59:40.859-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 05:59:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:00:10.997-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:00:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:00:41.193-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:00:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:01:11.338-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:01:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:01:41.605-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:01:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:02:11.928-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:02:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:02:42.205-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:02:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:03:12.510-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:03:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:03:42.784-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:03:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:04:12.951-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:04:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:04:43.148-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:04:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:05:13.354-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:05:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:05:43.647-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:05:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:06:13.856-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:06:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:06:44.112-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:06:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:07:14.435-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:07:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:07:44.580-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:07:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:08:14.872-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:08:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:08:45.142-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:08:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:09:15.440-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:09:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:09:45.669-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:09:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:10:16.075-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:10:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:10:46.432-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:10:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:11:16.793-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:11:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:11:47.296-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:11:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:12:17.623-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:12:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:12:47.766-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:12:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:13:18.092-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:13:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:13:48.411-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:13:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:14:18.827-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:14:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:14:49.153-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:14:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:15:19.410-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:15:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:15:49.726-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:15:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:16:19.986-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:16:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:16:50.289-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:16:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:17:20.633-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:17:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:17:50.833-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:17:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:18:21.112-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:18:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:18:51.541-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:18:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:19:21.706-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:19:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:19:52.116-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:19:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:20:22.306-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:20:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:20:52.595-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:20:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:21:22.879-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:21:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:21:53.182-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:21:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:22:23.459-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:22:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:22:53.734-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:22:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:23:23.884-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:23:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:23:54.125-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:23:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:24:24.379-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:24:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:24:54.783-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:24:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:25:25.066-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:25:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:25:55.307-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:25:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:26:25.752-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:26:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:26:56.045-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:26:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:27:26.318-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:27:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:27:56.603-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:27:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:28:26.759-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:28:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:28:56.910-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:28:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:29:27.245-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:29:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:29:57.508-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:29:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:30:27.812-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:30:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:30:58.103-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:30:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:31:28.385-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:31:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:31:58.574-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:31:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:32:28.845-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:32:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:32:59.156-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:32:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:33:29.444-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:33:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:33:59.891-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:33:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:34:30.193-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:34:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:35:00.559-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:35:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:35:30.860-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:35:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:36:01.150-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:36:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:36:31.311-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:36:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:37:01.608-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:37:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:37:32.086-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:37:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:38:02.344-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:38:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:38:32.635-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:38:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:39:02.953-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:39:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:39:33.241-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:39:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:40:03.529-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:40:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:40:33.790-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:40:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:41:04.169-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:41:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:41:34.551-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:41:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:42:04.836-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:42:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:42:35.128-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:42:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:43:05.432-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:43:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:43:35.563-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:43:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:44:05.765-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:44:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:44:36.033-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:44:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:45:06.252-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:45:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:45:36.501-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:45:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:46:06.803-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:46:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:46:37.209-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:46:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:47:07.435-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:47:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:47:37.755-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:47:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:48:08.027-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:48:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:48:38.263-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:48:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:49:08.606-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:49:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:49:38.890-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:49:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:50:09.050-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:50:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:50:39.338-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:50:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:51:09.653-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:51:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:51:39.917-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:51:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:52:10.188-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:52:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:52:40.417-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:52:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:53:10.694-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:53:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:53:41.019-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:53:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:54:11.201-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:54:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:54:41.467-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:54:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:55:11.807-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:55:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:55:41.956-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:55:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:56:12.210-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:56:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:56:42.474-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:56:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:57:12.663-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:57:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:57:42.963-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:57:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:58:13.364-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:58:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:58:43.633-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:58:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:59:14.365-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:59:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T06:59:44.660-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 06:59:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:00:14.866-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:00:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:00:45.175-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:00:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:01:15.421-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:01:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:01:45.688-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:01:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:02:16.015-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:02:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:02:46.288-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:02:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:03:16.422-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:03:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:03:46.686-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:03:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:04:16.950-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:04:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:04:47.228-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:04:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:05:17.564-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:05:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:05:47.845-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:05:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:06:18.190-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:06:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:06:48.513-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:06:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:07:18.853-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:07:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:07:49.136-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:07:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:08:19.434-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:08:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:08:49.731-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:08:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:09:19.938-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:09:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:09:50.301-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:09:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:10:20.701-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:10:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:10:50.918-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:10:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:11:21.199-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:11:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:11:51.439-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:11:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:12:21.731-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:12:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:12:52.072-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:12:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:13:22.377-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:13:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:13:52.642-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:13:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:14:22.813-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:14:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:14:53.095-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:14:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:15:23.370-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:15:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:15:53.658-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:15:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:16:23.917-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:16:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:16:54.194-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:16:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:17:24.390-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:17:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:17:54.673-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:17:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:18:24.852-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:18:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:18:55.144-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:18:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:19:25.416-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:19:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:19:55.689-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:19:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:20:26.037-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:20:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:20:56.310-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:20:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:21:26.593-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:21:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:21:56.878-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:21:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:22:27.168-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:22:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:22:57.462-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:22:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:23:27.848-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:23:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:23:58.196-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:23:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:24:28.485-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:24:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:24:58.889-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:24:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:25:29.149-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:25:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:25:59.440-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:25:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:26:29.667-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:26:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:26:59.997-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:26:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:27:30.188-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:27:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:28:00.354-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:28:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:28:30.592-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:28:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:29:00.862-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:29:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:29:31.210-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:29:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:30:01.423-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:30:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:30:31.862-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:30:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:31:02.150-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:31:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:31:32.419-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:31:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:32:02.568-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:32:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:32:32.865-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:32:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:33:03.027-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:33:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:33:33.308-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:33:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:34:03.504-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:34:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:34:33.693-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:34:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:35:04.073-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:35:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:35:34.440-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:35:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:36:04.813-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:36:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:36:35.194-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:36:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:37:05.494-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:37:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:37:35.828-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:37:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:38:05.974-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:38:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:38:36.256-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:38:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:39:06.551-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:39:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:39:36.753-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:39:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:40:07.045-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:40:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:40:37.328-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:40:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:41:07.532-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:41:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:41:37.786-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:41:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:42:08.064-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:42:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:42:38.381-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:42:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:43:08.711-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:43:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:43:38.865-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:43:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:44:09.013-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:44:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:44:39.293-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:44:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:45:09.558-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:45:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:45:39.826-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:45:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:46:10.125-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:46:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:46:40.452-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:46:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:47:10.593-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:47:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:47:40.866-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:47:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:48:11.139-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:48:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:48:41.404-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:48:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:49:11.553-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:49:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:49:41.848-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:49:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:50:12.157-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:50:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:50:42.416-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:50:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:51:12.787-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:51:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:51:43.125-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:51:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:52:13.368-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:52:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:52:43.638-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:52:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:53:13.939-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:53:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:53:44.208-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:53:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:54:14.713-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:54:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:54:45.067-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:54:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:55:15.228-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:55:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:55:45.497-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:55:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:56:15.780-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:56:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:56:46.069-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:56:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:57:16.359-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:57:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:57:46.665-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:57:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:58:16.943-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:58:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:58:47.216-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:58:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:59:17.666-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:59:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T07:59:47.980-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 07:59:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:00:18.261-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:00:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:00:48.511-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:00:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:01:18.808-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:01:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:01:49.150-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:01:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:02:19.536-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:02:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:02:49.833-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:02:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:03:20.019-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:03:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:03:50.278-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:03:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:04:20.421-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:04:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:04:50.664-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:04:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:05:20.904-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:05:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:05:51.227-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:05:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:06:21.508-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:06:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:06:51.777-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:06:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:07:22.049-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:07:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:07:52.251-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:07:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:08:22.545-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:08:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:08:52.863-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:08:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:09:23.138-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:09:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:09:53.424-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:09:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:10:23.626-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:10:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:10:53.922-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:10:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:11:24.181-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:11:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:11:54.468-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:11:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:12:24.714-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:12:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:12:55.062-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:12:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:13:25.291-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:13:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:13:55.589-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:13:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:14:25.886-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:14:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:14:56.331-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:14:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:15:26.564-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:15:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:15:57.009-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:15:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:16:27.152-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:16:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:16:57.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:16:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:17:27.619-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:17:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:17:58.075-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:17:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:18:28.462-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:18:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:18:58.745-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:18:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:19:29.007-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:19:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:19:59.278-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:19:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:20:29.624-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:20:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:20:59.905-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:20:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:21:30.179-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:21:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:22:00.580-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:22:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:22:30.904-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:22:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:23:01.196-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:23:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:23:31.479-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:23:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:24:01.686-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:24:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:24:32.001-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:24:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:25:02.189-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:25:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:25:32.435-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:25:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:26:02.822-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:26:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:26:33.060-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:26:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:27:03.346-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:27:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:27:33.656-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:27:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:28:03.851-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:28:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:28:33.986-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:28:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:29:04.244-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:29:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:29:34.504-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:29:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:30:04.706-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:30:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:30:34.870-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:30:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:31:05.130-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:31:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:31:35.411-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:31:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:32:05.713-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:32:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:32:35.910-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:32:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:33:06.060-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:33:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:33:36.341-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:33:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:34:06.649-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:34:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:34:36.833-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:34:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:35:07.107-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:35:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:35:37.386-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:35:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:36:07.746-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:36:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:36:37.915-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:36:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:37:08.176-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:37:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:37:38.521-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:37:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:38:08.710-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:38:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:38:38.976-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:38:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:39:09.162-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:39:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:39:39.421-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:39:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:40:09.841-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:40:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:40:40.177-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:40:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:41:10.496-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:41:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:41:40.779-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:41:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:42:11.146-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:42:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:42:41.409-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:42:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:43:11.590-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:43:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:43:41.951-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:43:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:44:12.234-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:44:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:44:42.516-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:44:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:45:12.667-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:45:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:45:42.968-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:45:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:46:13.383-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:46:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:46:43.677-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:46:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:47:13.926-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:47:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:47:44.178-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:47:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:48:14.448-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:48:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:48:44.879-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:48:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:49:15.073-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:49:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:49:45.257-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:49:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:50:15.662-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:50:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:50:46.025-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:50:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:51:16.395-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:51:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:51:46.693-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:51:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:52:16.855-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:52:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:52:47.143-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:52:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:53:17.417-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:53:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:53:47.775-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:53:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:54:18.006-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:54:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:54:48.449-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:54:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:55:18.693-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:55:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:55:48.952-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:55:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:56:19.141-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:56:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:56:49.384-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:56:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:57:19.665-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:57:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:57:50.015-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:57:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:58:20.277-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:58:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:58:50.561-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:58:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:59:20.862-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:59:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T08:59:51.255-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 08:59:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:00:21.457-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:00:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:00:51.682-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:00:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:01:21.969-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:01:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:01:52.396-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:01:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:02:22.767-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:02:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:02:53.100-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:02:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:03:23.409-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:03:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:03:53.652-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:03:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:04:23.916-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:04:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:04:54.172-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:04:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:05:24.522-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:05:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:05:54.766-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:05:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:06:25.048-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:06:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:06:55.377-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:06:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:07:25.700-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:07:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:07:56.037-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:07:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:08:26.393-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:08:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:08:56.681-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:08:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:09:27.038-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:09:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:09:57.392-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:09:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:10:27.618-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:10:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:10:57.928-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:10:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:11:28.233-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:11:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:11:58.516-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:11:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:12:28.792-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:12:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:12:59.041-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:12:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:13:29.352-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:13:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:13:59.612-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:13:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:14:29.807-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:14:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:15:00.143-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:14:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:15:30.448-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:15:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:16:00.733-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:16:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:16:31.106-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:16:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:17:01.412-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:17:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:17:31.703-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:17:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:18:02.147-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:18:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:18:32.440-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:18:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:19:02.711-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:19:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:19:32.959-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:19:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:20:03.336-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:20:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:20:33.648-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:20:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:21:03.884-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:21:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:21:34.154-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:21:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:22:04.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:22:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:22:34.724-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:22:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:23:04.913-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:23:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:23:35.162-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:23:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:24:05.372-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:24:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:24:35.666-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:24:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:25:05.877-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:25:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:25:36.104-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:25:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:26:06.404-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:26:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:26:36.663-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:26:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:27:06.920-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:27:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:27:37.331-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:27:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:28:07.672-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:28:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:28:37.949-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:28:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:29:08.251-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:29:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:29:38.445-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:29:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:30:08.745-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:30:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:30:38.933-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:30:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:31:09.190-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:31:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:31:39.585-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:31:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:32:09.884-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:32:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:32:40.254-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:32:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:33:10.515-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:33:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:33:40.771-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:33:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:34:11.049-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:34:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:34:41.236-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:34:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:35:11.670-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:35:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:35:41.907-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:35:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:36:12.183-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:36:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:36:42.456-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:36:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:37:12.751-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:37:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:37:42.986-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:37:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:38:13.290-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:38:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:38:43.533-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:38:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:39:13.746-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:39:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:39:44.065-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:39:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:40:14.368-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:40:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:40:44.654-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:40:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:41:14.931-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:41:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:41:45.266-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:41:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:42:15.539-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:42:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:42:45.844-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:42:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:43:16.099-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:43:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:43:46.414-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:43:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:44:16.822-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:44:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:44:47.089-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:44:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:45:17.506-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:45:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:45:47.755-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:45:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:46:18.247-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:46:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:46:48.616-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:46:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:47:18.912-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:47:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:47:49.194-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:47:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:48:19.419-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:48:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:48:49.802-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:48:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:49:20.096-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:49:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:49:50.481-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:49:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:50:20.760-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:50:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:50:51.042-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:50:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:51:21.367-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:51:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:51:51.715-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:51:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:52:21.983-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:52:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:52:52.254-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:52:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:53:22.582-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:53:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:53:52.975-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:53:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:54:23.199-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:54:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:54:53.457-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:54:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:55:23.855-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:55:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:55:54.163-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:55:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:56:24.516-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:56:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:56:54.934-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:56:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:57:25.154-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:57:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:57:55.439-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:57:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:58:25.973-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:58:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:58:56.335-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:58:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:59:26.546-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:59:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T09:59:56.756-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 09:59:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:00:26.952-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:00:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:00:57.199-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:00:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:01:27.523-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:01:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:01:57.735-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:01:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:02:27.881-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:02:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:02:58.188-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:02:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:03:28.521-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:03:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:03:58.794-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:03:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:04:29.065-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:04:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:04:59.430-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:04:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:05:29.740-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:05:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:05:59.935-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:05:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:06:30.331-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:06:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:07:00.683-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:07:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:07:31.062-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:07:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:08:01.487-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:08:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:08:31.770-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:08:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:09:02.062-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:09:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:09:32.399-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:09:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:10:02.663-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:10:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:10:32.900-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:10:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:11:03.158-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:11:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:11:33.392-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:11:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:12:03.732-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:12:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:12:34.054-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:12:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:13:04.290-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:13:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:13:34.438-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:13:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:14:04.707-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:14:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:14:34.974-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:14:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:15:05.424-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:15:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:15:35.694-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:15:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:16:05.979-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:16:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:16:36.220-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:16:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:17:06.462-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:17:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:17:36.752-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:17:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:18:07.060-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:18:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:18:37.250-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:18:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:19:07.527-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:19:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:19:37.889-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:19:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:20:08.149-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:20:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:20:38.430-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:20:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:21:08.817-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:21:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:21:39.115-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:21:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:22:09.365-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:22:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:22:39.643-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:22:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:23:09.953-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:23:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:23:40.245-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:23:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:24:10.522-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:24:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:24:40.678-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:24:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:25:10.843-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:25:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:25:41.142-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:25:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:26:11.365-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:26:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:26:41.734-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:26:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:27:12.040-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:27:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:27:42.195-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:27:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:28:12.482-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:28:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:28:42.873-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:28:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:29:13.069-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:29:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:29:43.334-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:29:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:30:13.576-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:30:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:30:43.859-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:30:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:31:14.115-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:31:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:31:44.393-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:31:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:32:14.670-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:32:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:32:44.984-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:32:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:33:15.292-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:33:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:33:45.674-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:33:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:34:16.047-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:34:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:34:46.357-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:34:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:35:16.784-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:35:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:35:47.157-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:35:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:36:17.424-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:36:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:36:47.712-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:36:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:37:18.012-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:37:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:37:48.425-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:37:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:38:18.774-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:38:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:38:49.009-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:38:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:39:19.279-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:39:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:39:49.559-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:39:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:40:19.806-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:40:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:40:50.234-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:40:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:41:20.510-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:41:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:41:50.815-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:41:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:42:21.073-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:42:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:42:51.319-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:42:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:43:21.614-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:43:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:43:51.768-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:43:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:44:21.925-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:44:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:44:52.169-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:44:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:45:22.448-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:45:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:45:52.724-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:45:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:46:22.970-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:46:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:46:53.257-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:46:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:47:23.478-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:47:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:47:53.916-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:47:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:48:24.248-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:48:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:48:54.475-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:48:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:49:24.720-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:49:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:49:55.081-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:49:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:50:25.343-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:50:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:50:55.583-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:50:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:51:25.942-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:51:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:51:56.242-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:51:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:52:26.567-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:52:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:52:56.815-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:52:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:53:27.146-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:53:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:53:57.421-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:53:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:54:27.681-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:54:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:54:57.888-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:54:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:55:28.150-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:55:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:55:58.443-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:55:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:56:28.775-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:56:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:56:59.040-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:56:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:57:29.306-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:57:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:57:59.636-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:57:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:58:29.945-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:58:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:59:00.272-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:58:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T10:59:30.430-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 10:59:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:00:00.699-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:00:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:00:30.975-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:00:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:01:01.188-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:01:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:01:31.624-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:01:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:02:01.914-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:02:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:02:32.171-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:02:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:03:02.479-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:03:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:03:32.960-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:03:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:04:03.180-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:04:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:04:33.513-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:04:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:05:03.752-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:05:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:05:33.950-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:05:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:06:04.221-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:06:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:06:34.571-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:06:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:07:04.776-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:07:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:07:34.977-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:07:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:08:05.394-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:08:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:08:35.795-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:08:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:09:05.996-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:09:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:09:36.280-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:09:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:10:06.475-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:10:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:10:36.747-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:10:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:11:06.969-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:11:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:11:37.280-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:11:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:12:07.588-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:12:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:12:37.880-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:12:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:13:08.199-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:13:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:13:38.418-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:13:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:14:08.641-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:14:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:14:38.893-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:14:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:15:09.109-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:15:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:15:39.371-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:15:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:16:09.620-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:16:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:16:40.009-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:16:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:17:10.338-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:17:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:17:40.581-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:17:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:18:10.926-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:18:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:18:41.226-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:18:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:19:11.503-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:19:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:19:41.784-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:19:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:20:12.068-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:20:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:20:42.400-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:20:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:21:12.655-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:21:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:21:42.788-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:21:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:22:12.988-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:22:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:22:43.282-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:22:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:23:13.423-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:23:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:23:43.617-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:23:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:24:13.771-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:24:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:24:44.127-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:24:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:25:14.508-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:25:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:25:44.698-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:25:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:26:15.148-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:26:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:26:45.564-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:26:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:27:15.816-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:27:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:27:46.102-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:27:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:28:16.566-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:28:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:28:46.881-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:28:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:29:17.205-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:29:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:29:47.478-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:29:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:30:17.630-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:30:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:30:47.862-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:30:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:31:18.198-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:31:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:31:48.485-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:31:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:32:18.885-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:32:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:32:49.188-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:32:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:33:19.497-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:33:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:33:49.800-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:33:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:34:20.108-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:34:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:34:50.379-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:34:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:35:20.582-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:35:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:35:50.873-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:35:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:36:21.044-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:36:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:36:51.211-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:36:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:37:21.483-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:37:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:37:51.799-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:37:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:38:22.057-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:38:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:38:52.339-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:38:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:39:22.631-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:39:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:39:52.812-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:39:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:40:23.001-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:40:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:40:53.262-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:40:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:41:23.618-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:41:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:41:53.786-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:41:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:42:24.066-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:42:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:42:54.208-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:42:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:43:24.501-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:43:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:43:54.795-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:43:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:44:25.037-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:44:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:44:55.326-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:44:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:45:25.637-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:45:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:45:55.775-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:45:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:46:26.023-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:46:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:46:56.272-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:46:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:47:26.564-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:47:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:47:56.715-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:47:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:48:26.985-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:48:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:48:57.147-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:48:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:49:27.471-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:49:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:49:57.790-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:49:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:50:28.066-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:50:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:50:58.257-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:50:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:51:28.546-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:51:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:51:58.719-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:51:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:52:28.939-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:52:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:52:59.474-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:52:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:53:29.767-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:53:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:53:59.948-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:53:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:54:30.119-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:54:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:55:00.404-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:55:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:55:30.814-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:55:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:56:01.116-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:56:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:56:31.346-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:56:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:57:01.629-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:57:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:57:31.922-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:57:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:58:02.236-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:58:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:58:32.565-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:58:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:59:02.921-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:59:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T11:59:33.209-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 11:59:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:00:03.431-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:00:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:00:33.602-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:00:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:01:04.012-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:01:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:01:34.291-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:01:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:02:04.556-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:02:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:02:34.816-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:02:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:03:05.182-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:03:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:03:35.512-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:03:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:04:05.883-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:04:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:04:36.167-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:04:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:05:06.312-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:05:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:05:36.591-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:05:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:06:06.872-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:06:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:06:37.099-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:06:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:07:07.407-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:07:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:07:37.670-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:07:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:08:08.013-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:08:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:08:38.170-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:08:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:09:08.439-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:09:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:09:38.831-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:09:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:10:09.159-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:10:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:10:39.460-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:10:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:11:09.634-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:11:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:11:39.913-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:11:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:12:10.212-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:12:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:12:40.546-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:12:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:13:10.841-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:13:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:13:41.069-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:13:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:14:11.335-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:14:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:14:41.658-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:14:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:15:11.839-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:15:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:15:42.139-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:15:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:16:12.303-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:16:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:16:42.517-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:16:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:17:12.800-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:17:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:17:43.096-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:17:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:18:13.280-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:18:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:18:43.574-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:18:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:19:13.833-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:19:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:19:44.145-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:19:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:20:14.342-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:20:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:20:44.618-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:20:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:21:14.895-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:21:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:21:45.158-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:21:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:22:15.363-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:22:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:22:45.646-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:22:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:23:15.793-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:23:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:23:46.129-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:23:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:24:16.263-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:24:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:24:46.513-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:24:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:25:16.862-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:25:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:25:47.214-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:25:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:26:17.396-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:26:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:26:47.788-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:26:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:27:18.082-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:27:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:27:48.320-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:27:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:28:18.493-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:28:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:28:48.785-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:28:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:29:19.073-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:29:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:29:49.313-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:29:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:30:19.595-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:30:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:30:49.961-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:30:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:31:20.242-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:31:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:31:50.426-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:31:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:32:20.682-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:32:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:32:51.015-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:32:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:33:21.158-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:33:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:33:51.436-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:33:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:34:21.663-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:34:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:34:51.939-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:34:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:35:22.222-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:35:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:35:52.379-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:35:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:36:22.744-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:36:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:36:53.007-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:36:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:37:23.224-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:37:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:37:53.501-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:37:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:38:23.674-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:38:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:38:53.959-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:38:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:39:24.226-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:39:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:39:54.492-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:39:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:40:24.754-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:40:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:40:54.936-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:40:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:41:25.121-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:41:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:41:55.262-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:41:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:42:25.534-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:42:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:42:55.746-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:42:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:43:26.047-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:43:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:43:56.346-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:43:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:44:26.621-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:44:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:44:56.891-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:44:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:45:27.249-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:45:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:45:57.488-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:45:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:46:27.725-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:46:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:46:58.004-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:46:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:47:28.278-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:47:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:47:58.460-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:47:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:48:28.763-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:48:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:48:59.038-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:48:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:49:29.326-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:49:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:49:59.564-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:49:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:50:29.701-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:50:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:50:59.932-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:50:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:51:30.229-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:51:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:52:00.485-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:52:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:52:30.760-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:52:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:53:01.068-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:53:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:53:31.207-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:53:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:54:01.625-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:54:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:54:31.784-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:54:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:55:02.118-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:55:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:55:32.394-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:55:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:56:02.690-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:56:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:56:32.841-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:56:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:57:03.125-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:57:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:57:33.405-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:57:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:58:03.706-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:58:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:58:34.041-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:58:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:59:04.312-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:59:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T12:59:34.592-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 12:59:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:00:04.856-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:00:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:00:35.120-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:00:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:01:05.538-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:01:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:01:35.810-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:01:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:02:06.110-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:02:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:02:36.376-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:02:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:03:06.571-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:03:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:03:36.706-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:03:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:04:06.977-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:04:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:04:37.277-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:04:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:05:07.558-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:05:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:05:37.754-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:05:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:05:58.177-0500 [conn18] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T13:06:08.008-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:06:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:06:38.276-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:06:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:07:08.565-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:07:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:07:38.851-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:07:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:08:09.137-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:08:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:08:39.503-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:08:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:09:09.963-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:09:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:09:40.254-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:09:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:10:10.409-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:10:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:10:40.678-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:10:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:11:02.310-0500 [conn19] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T13:11:10.919-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:11:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:11:41.207-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:11:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:12:11.451-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:12:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:12:41.736-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:12:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:13:11.896-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:13:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:13:42.323-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:13:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:14:12.621-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:14:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:14:42.908-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:14:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:15:13.074-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:15:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:15:43.305-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:15:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:16:02.182-0500 [conn20] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T13:16:13.593-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:16:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:16:43.844-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:16:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:17:14.008-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:17:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:17:44.338-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:17:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:18:14.615-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:18:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:18:45.023-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:18:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:19:15.333-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:19:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:19:45.632-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:19:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:20:15.936-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:20:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:20:46.141-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:20:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:21:02.134-0500 [conn21] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T13:21:16.452-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:21:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:21:46.743-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:21:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:22:17.068-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:22:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:22:47.324-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:22:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:23:17.547-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:23:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:23:47.879-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:23:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:24:18.118-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:24:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:24:48.393-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:24:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:25:12.134-0500 [conn22] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:25:12.323-0500 [conn23] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:25:12.434-0500 [conn24] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:25:12.545-0500 [conn25] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:25:12.750-0500 [conn26] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:25:12.960-0500 [conn27] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:25:13.177-0500 [conn28] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:25:13.287-0500 [conn29] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:25:13.398-0500 [conn30] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:25:18.630-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:25:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:25:44.924-0500 [conn38] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:25:44.930-0500 [conn39] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:25:46.953-0500 [conn65] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:25:47.037-0500 [conn67] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:25:47.064-0500 [conn68] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:25:47.474-0500 [conn85] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:25:47.581-0500 [conn98] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:25:48.075-0500 [conn100] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:25:48.785-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:25:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:25:58.631-0500 [conn104] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:26:02.301-0500 [conn108] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T13:26:07.690-0500 [conn109] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:26:07.695-0500 [conn110] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:26:11.403-0500 [conn117] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:26:11.407-0500 [conn120] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:26:11.774-0500 [conn173] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:26:11.784-0500 [conn175] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:26:11.840-0500 [conn183] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:26:11.903-0500 [conn190] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:26:11.997-0500 [conn209] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:26:12.902-0500 [conn289] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:26:13.055-0500 [conn312] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:26:13.556-0500 [conn371] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:26:14.108-0500 [conn438] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:26:14.989-0500 [conn563] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:26:15.466-0500 [conn599] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:26:15.472-0500 [conn600] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:26:16.023-0500 [conn627] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:26:16.031-0500 [conn628] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:26:16.245-0500 [conn636] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:26:16.251-0500 [conn637] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:26:16.328-0500 [conn644] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:26:16.945-0500 [conn745] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:26:18.863-0500 [conn878] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:26:19.100-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:26:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:26:19.344-0500 [conn919] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:26:19.993-0500 [conn985] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:26:20.007-0500 [conn988] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:26:20.113-0500 [conn999] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:26:20.127-0500 [conn1000] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:26:20.295-0500 [conn1017] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:26:20.474-0500 [conn1031] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-26T13:26:49.358-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:26:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:27:19.512-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:27:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:27:49.736-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:27:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:28:20.018-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:28:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:28:50.350-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:28:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:29:20.522-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:29:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:29:50.706-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:29:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:30:20.945-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:30:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:30:51.277-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:30:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:31:02.218-0500 [conn1184] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T13:31:21.589-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:31:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:31:51.936-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:31:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:32:22.240-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:32:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:32:52.515-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:32:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:33:22.802-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:33:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:33:53.253-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:33:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:34:23.536-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:34:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:34:53.810-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:34:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:35:24.088-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:35:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:35:54.381-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:35:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:36:02.232-0500 [conn1185] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T13:36:24.532-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:36:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:36:54.819-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:36:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:37:25.228-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:37:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:37:55.510-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:37:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:38:25.787-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:38:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:38:56.062-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:38:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:39:26.208-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:39:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:39:56.479-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:39:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:40:26.789-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:40:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:40:57.201-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:40:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:41:02.214-0500 [conn1186] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T13:41:27.468-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:41:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:41:57.810-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:41:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:42:28.094-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:42:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:42:58.379-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:42:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:43:28.689-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:43:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:43:58.965-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:43:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:44:29.161-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:44:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:44:59.353-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:44:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:45:29.628-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:45:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:45:59.868-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:45:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:46:02.302-0500 [conn1187] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T13:46:30.163-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:46:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:47:00.330-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:47:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:47:30.518-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:47:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:48:00.795-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:48:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:48:31.075-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:48:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:49:01.351-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:49:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:49:31.747-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:49:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:50:02.039-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:50:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:50:32.265-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:50:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:51:02.292-0500 [conn1188] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T13:51:02.542-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:51:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:51:32.829-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:51:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:52:03.107-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:52:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:52:33.407-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:52:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:53:03.635-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:53:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:53:33.922-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:53:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:54:04.108-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:54:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:54:34.397-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:54:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:55:04.578-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:55:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:55:34.768-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:55:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:56:02.083-0500 [conn1189] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T13:56:04.900-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:56:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:56:35.046-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:56:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:57:05.267-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:57:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:57:35.633-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:57:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:58:05.921-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:58:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:58:36.144-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:58:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:59:06.532-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:59:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T13:59:36.795-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 13:59:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:00:07.283-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:00:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:00:37.536-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:00:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:01:02.187-0500 [conn1190] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T14:01:07.751-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:01:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:01:38.174-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:01:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:02:08.378-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:02:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:02:38.675-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:02:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:03:08.834-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:03:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:03:39.127-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:03:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:04:09.489-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:04:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:04:39.644-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:04:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:05:09.981-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:05:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:05:40.233-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:05:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:06:02.271-0500 [conn1191] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T14:06:10.544-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:06:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:06:40.754-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:06:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:07:11.070-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:07:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:07:41.336-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:07:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:08:11.652-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:08:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:08:41.911-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:08:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:09:12.120-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:09:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:09:42.316-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:09:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:10:12.773-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:10:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:10:43.050-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:10:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:11:02.262-0500 [conn1192] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T14:11:13.351-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:11:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:11:43.489-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:11:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:12:13.966-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:12:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:12:44.274-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:12:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:13:14.566-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:13:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:13:44.802-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:13:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:14:15.078-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:14:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:14:45.361-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:14:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:15:15.611-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:15:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:15:45.909-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:15:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:16:02.294-0500 [conn1193] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T14:16:16.378-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:16:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:16:46.673-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:16:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:17:17.024-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:17:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:17:47.239-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:17:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:18:17.522-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:18:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:18:47.789-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:18:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:19:18.067-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:19:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:19:48.405-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:19:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:20:18.818-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:20:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:20:49.113-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:20:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:21:02.193-0500 [conn1194] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T14:21:19.362-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:21:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:21:49.778-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:21:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:22:20.044-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:22:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:22:50.319-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:22:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:23:20.549-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:23:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:23:50.915-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:23:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:24:21.098-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:24:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:24:51.330-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:24:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:25:21.636-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:25:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:25:51.818-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:25:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:26:02.171-0500 [conn1195] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T14:26:22.165-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:26:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:26:52.414-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:26:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:27:22.687-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:27:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:27:52.941-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:27:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:28:23.299-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:28:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:28:53.639-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:28:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:29:23.895-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:29:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:29:54.183-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:29:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:30:24.439-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:30:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:30:54.586-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:30:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:31:24.874-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:31:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:31:55.145-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:31:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:32:25.428-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:32:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:32:55.891-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:32:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:33:26.169-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:33:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:33:32.212-0500 [conn1196] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T14:33:56.465-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:33:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:34:26.818-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:34:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:34:57.079-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:34:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:35:27.369-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:35:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:35:57.629-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:35:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:36:27.945-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:36:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:36:58.214-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:36:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:37:28.500-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:37:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:37:58.756-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:37:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:38:29.023-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:38:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:38:32.132-0500 [conn1197] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T14:38:59.163-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:38:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:39:29.549-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:39:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:39:59.915-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:39:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:40:30.216-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:40:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:41:00.492-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:41:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:41:30.785-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:41:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:42:01.066-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:42:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:42:31.320-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:42:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:43:01.587-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:43:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:43:31.866-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:43:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:43:32.285-0500 [conn1198] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T14:44:02.013-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:44:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:44:32.343-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:44:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:45:02.680-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:45:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:45:32.984-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:45:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:46:03.294-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:46:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:46:33.694-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:46:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:47:03.903-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:47:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:47:34.169-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:47:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:48:04.566-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:48:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:48:32.219-0500 [conn1199] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T14:48:34.929-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:48:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:49:05.261-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:49:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:49:35.494-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:49:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:50:05.693-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:50:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:50:35.966-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:50:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:51:06.247-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:51:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:51:36.403-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:51:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:52:06.659-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:52:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:52:36.960-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:52:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:53:07.164-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:53:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:53:32.109-0500 [conn1200] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T14:53:37.453-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:53:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:54:07.820-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:54:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:54:38.148-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:54:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:55:08.362-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:55:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:55:38.635-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:55:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:56:08.880-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:56:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:56:39.091-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:56:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:57:09.372-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:57:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:57:39.709-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:57:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:58:09.950-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:58:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:58:32.264-0500 [conn1201] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T14:58:40.247-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:58:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:59:10.542-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:59:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T14:59:40.839-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 14:59:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:00:11.227-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:00:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:00:41.532-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:00:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:01:11.805-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:01:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:01:42.099-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:01:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:02:12.274-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:02:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:02:42.556-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:02:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:03:12.841-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:03:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:03:32.307-0500 [conn1202] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T15:03:43.290-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:03:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:04:13.582-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:04:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:04:43.840-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:04:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:05:14.179-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:05:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:05:44.457-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:05:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:06:14.694-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:06:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:06:44.973-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:06:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:07:15.258-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:07:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:07:45.474-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:07:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:08:15.747-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:08:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:08:32.185-0500 [conn1203] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T15:08:46.016-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:08:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:09:16.358-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:09:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:09:46.623-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:09:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:10:16.976-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:10:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:10:47.257-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:10:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:11:17.514-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:11:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:11:47.792-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:11:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:12:18.108-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:12:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:12:48.434-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:12:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:13:18.724-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:13:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:13:37.172-0500 [conn1204] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T15:13:49.015-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:13:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:14:19.378-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:14:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:14:49.643-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:14:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:15:19.823-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:15:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:15:49.968-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:15:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:16:20.222-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:16:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:16:50.538-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:16:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:17:20.832-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:17:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:17:51.109-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:17:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:18:21.388-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:18:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:18:37.120-0500 [conn1205] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T15:18:51.822-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:18:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:19:22.093-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:19:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:19:52.331-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:19:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:20:22.574-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:20:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:20:52.781-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:20:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:21:23.044-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:21:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:21:53.347-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:21:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:22:23.606-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:22:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:22:53.883-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:22:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:23:24.076-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:23:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:23:37.357-0500 [conn1206] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T15:23:54.279-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:23:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:24:24.699-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:24:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:24:54.957-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:24:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:25:25.386-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:25:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:25:55.724-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:25:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:26:26.005-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:26:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:26:56.199-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:26:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:27:26.329-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:27:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:27:56.489-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:27:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:28:26.764-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:28:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:28:37.133-0500 [conn1207] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T15:28:57.084-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:28:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:29:27.506-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:29:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:29:57.803-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:29:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:30:28.065-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:30:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:30:58.365-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:30:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:31:28.518-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:31:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:31:58.805-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:31:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:32:28.993-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:32:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:32:59.364-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:32:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:33:29.637-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:33:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:33:37.475-0500 [conn1208] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T15:33:59.866-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:33:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:34:30.195-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:34:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:35:00.543-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:35:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:35:30.818-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:35:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:36:01.104-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:36:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:36:31.236-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:36:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:37:01.506-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:37:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:37:31.784-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:37:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:38:02.055-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:38:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:38:32.324-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:38:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:38:37.347-0500 [conn1209] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T15:39:02.482-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:39:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:39:32.765-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:39:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:40:02.974-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:40:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:40:33.160-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:40:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:41:03.304-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:41:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:41:33.613-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:41:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:42:03.840-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:42:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:42:34.069-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:42:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:43:04.332-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:43:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:43:34.584-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:43:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:43:37.601-0500 [conn1210] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T15:44:04.857-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:44:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:44:35.138-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:44:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:45:05.331-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:45:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:45:35.732-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:45:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:46:05.889-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:46:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:46:36.178-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:46:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:47:06.358-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:47:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:47:36.495-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:47:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:48:06.764-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:48:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:48:36.919-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:48:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:48:37.185-0500 [conn1211] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T15:49:07.486-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:49:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:49:37.686-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:49:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:50:07.973-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:50:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:50:38.240-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:50:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:51:08.771-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:51:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:51:39.058-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:51:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:52:09.224-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:52:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:52:39.484-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:52:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:53:09.743-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:53:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:53:37.139-0500 [conn1212] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T15:53:40.013-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:53:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:54:10.167-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:54:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:54:40.436-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:54:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:55:10.710-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:55:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:55:40.996-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:55:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:56:11.141-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:56:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:56:41.406-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:56:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:57:11.664-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:57:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:57:41.827-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:57:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:58:11.970-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:58:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:58:37.134-0500 [conn1213] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T15:58:42.232-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:58:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:59:12.515-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:59:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T15:59:42.696-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 15:59:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:00:12.986-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:00:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:00:43.253-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:00:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:01:13.419-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:01:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:01:43.690-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:01:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:02:13.873-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:02:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:02:44.209-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:02:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:03:14.498-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:03:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:03:37.242-0500 [conn1214] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T16:03:44.948-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:03:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:04:15.225-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:04:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:04:45.471-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:04:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:05:15.788-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:05:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:05:46.080-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:05:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:06:16.214-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:06:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:06:46.495-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:06:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:07:16.865-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:07:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:07:47.120-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:07:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:08:17.393-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:08:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:08:37.323-0500 [conn1215] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T16:08:47.546-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:08:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:09:17.933-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:09:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:09:48.180-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:09:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:10:18.460-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:10:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:10:48.745-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:10:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:11:18.984-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:11:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:11:49.168-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:11:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:12:19.470-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:12:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:12:49.629-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:12:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:13:19.809-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:13:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:13:37.238-0500 [conn1216] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T16:13:50.009-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:13:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:14:20.277-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:14:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:14:50.549-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:14:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:15:20.723-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:15:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:15:50.973-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:15:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:16:21.133-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:16:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:16:51.365-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:16:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:17:21.646-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:17:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:17:51.964-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:17:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:18:22.221-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:18:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:18:37.268-0500 [conn1217] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T16:18:52.518-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:18:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:19:22.856-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:19:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:19:53.143-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:19:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:20:23.402-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:20:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:20:53.686-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:20:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:21:23.835-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:21:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:21:54.092-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:21:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:22:24.522-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:22:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:22:54.701-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:22:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:23:25.028-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:23:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:23:37.277-0500 [conn1218] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T16:23:55.330-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:23:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:24:25.613-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:24:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:24:55.939-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:24:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:25:26.251-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:25:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:25:56.539-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:25:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:26:26.817-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:26:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:26:57.114-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:26:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:27:27.319-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:27:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:27:57.582-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:27:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:28:27.822-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:28:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:28:58.073-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:28:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:29:28.415-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:29:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:29:58.798-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:29:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:30:29.089-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:30:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:30:59.365-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:30:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:31:29.786-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:31:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:32:00.068-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:31:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:32:30.468-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:32:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:33:00.739-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:33:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:33:31.171-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:33:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:33:32.322-0500 [conn1219] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T16:34:01.455-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:34:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:34:31.596-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:34:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:35:01.967-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:35:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:35:32.298-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:35:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:36:02.464-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:36:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:36:32.803-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:36:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:37:03.081-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:37:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:37:33.436-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:37:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:38:03.584-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:38:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:38:32.295-0500 [conn1220] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T16:38:33.813-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:38:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:39:04.024-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:39:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:39:34.272-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:39:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:40:04.552-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:40:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:40:34.816-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:40:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:41:05.079-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:41:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:41:35.460-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:41:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:42:05.717-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:42:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:42:36.174-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:42:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:43:06.455-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:43:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:43:32.156-0500 [conn1221] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T16:43:36.820-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:43:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:44:07.069-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:44:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:44:37.363-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:44:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:45:07.606-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:45:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:45:37.858-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:45:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:46:08.194-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:46:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:46:38.451-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:46:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:47:08.752-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:47:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:47:39.037-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:47:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:48:09.342-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:48:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:48:32.237-0500 [conn1222] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T16:48:39.603-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:48:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:49:09.895-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:49:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:49:40.190-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:49:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:50:10.468-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:50:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:50:40.782-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:50:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:51:11.107-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:51:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:51:41.344-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:51:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:52:11.738-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:52:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:52:42.004-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:52:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:53:12.266-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:53:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:53:32.351-0500 [conn1223] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T16:53:42.615-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:53:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:54:12.894-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:54:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:54:43.165-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:54:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:55:13.404-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:55:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:55:43.673-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:55:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:56:13.904-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:56:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:56:44.168-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:56:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:57:14.535-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:57:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:57:44.829-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:57:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:58:15.111-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:58:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:58:32.138-0500 [conn1224] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T16:58:45.291-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:58:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:59:16.347-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:59:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T16:59:46.617-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 16:59:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:00:16.894-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:00:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:00:47.234-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:00:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:01:17.469-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:01:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:01:47.733-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:01:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:02:18.036-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:02:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:02:48.200-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:02:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:03:18.490-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:03:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:03:32.223-0500 [conn1225] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T17:03:48.755-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:03:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:04:18.958-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:04:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:04:49.296-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:04:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:05:19.554-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:05:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:05:49.842-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:05:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:06:19.992-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:06:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:06:50.317-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:06:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:07:20.628-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:07:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:07:50.949-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:07:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:08:21.207-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:08:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:08:32.235-0500 [conn1226] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T17:08:51.574-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:08:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:09:21.715-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:09:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:09:52.100-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:09:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:10:22.371-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:10:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:10:52.660-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:10:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:11:22.963-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:11:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:11:53.435-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:11:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:12:23.669-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:12:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:12:54.101-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:12:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:13:24.374-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:13:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:13:32.107-0500 [conn1227] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T17:13:54.701-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:13:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:14:24.888-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:14:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:14:55.171-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:14:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:15:25.447-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:15:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:15:55.815-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:15:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:16:26.146-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:16:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:16:56.337-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:16:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:17:26.482-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:17:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:17:56.615-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:17:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:18:26.918-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:18:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:18:32.300-0500 [conn1228] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T17:18:57.103-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:18:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:19:27.347-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:19:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:19:57.628-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:19:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:20:27.929-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:20:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:20:58.203-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:20:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:21:28.479-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:21:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:21:58.768-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:21:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:22:29.108-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:22:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:22:59.381-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:22:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:23:29.647-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:23:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:23:32.259-0500 [conn1229] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T17:23:59.941-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:23:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:24:30.167-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:24:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:25:00.465-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:25:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:25:30.768-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:25:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:26:00.924-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:26:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:26:31.188-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:26:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:27:01.464-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:27:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:27:31.673-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:27:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:28:01.921-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:28:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:28:32.194-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:28:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:28:32.264-0500 [conn1230] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T17:29:02.545-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:29:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:29:32.732-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:29:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:30:03.128-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:30:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:30:33.427-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:30:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:31:03.698-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:31:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:31:33.966-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:31:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:32:04.358-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:32:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:32:34.577-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:32:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:33:04.956-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:33:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:33:32.182-0500 [conn1231] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T17:33:35.213-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:33:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:34:05.489-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:34:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:34:35.778-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:34:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:35:06.068-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:35:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:35:36.358-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:35:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:36:06.631-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:36:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:36:36.955-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:36:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:37:07.265-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:37:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:37:37.531-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:37:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:38:07.905-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:38:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:38:32.436-0500 [conn1232] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T17:38:38.207-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:38:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:39:08.345-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:39:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:39:38.618-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:39:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:40:08.852-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:40:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:40:39.151-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:40:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:41:09.412-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:41:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:41:39.674-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:41:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:42:09.984-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:42:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:42:40.326-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:42:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:43:10.625-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:43:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:43:32.320-0500 [conn1233] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T17:43:40.917-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:43:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:44:11.086-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:44:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:44:41.348-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:44:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:45:11.489-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:45:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:45:41.778-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:45:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:46:12.071-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:46:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:46:42.349-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:46:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:47:12.680-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:47:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:47:42.860-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:47:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:48:13.048-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:48:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:48:32.359-0500 [conn1234] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T17:48:43.356-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:48:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:49:13.543-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:49:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:49:43.798-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:49:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:50:14.107-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:50:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:50:44.366-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:50:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:51:14.655-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:51:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:51:44.926-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:51:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:52:15.166-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:52:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:52:45.466-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:52:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:53:15.689-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:53:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:53:32.362-0500 [conn1235] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T17:53:45.973-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:53:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:54:16.240-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:54:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:54:46.523-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:54:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:55:16.828-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:55:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:55:46.985-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:55:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:56:17.193-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:56:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:56:47.441-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:56:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:57:17.727-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:57:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:57:47.892-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:57:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:58:18.060-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:58:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:58:32.229-0500 [conn1236] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T17:58:48.563-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:58:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:59:18.823-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:59:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T17:59:48.950-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 17:59:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:00:19.090-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:00:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:00:49.472-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:00:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:01:19.744-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:01:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:01:50.092-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:01:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:02:07.077-0500 [conn1237] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T18:02:20.379-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:02:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:02:50.592-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:02:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:03:20.873-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:03:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:03:51.270-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:03:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:04:21.519-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:04:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:04:51.783-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:04:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:05:22.164-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:05:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:05:52.389-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:05:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:06:22.665-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:06:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:06:52.885-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:06:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:07:23.177-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:07:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:07:53.570-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:07:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:08:02.213-0500 [conn1238] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T18:08:23.820-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:08:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:08:54.107-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:08:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:09:24.367-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:09:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:09:54.682-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:09:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:10:24.959-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:10:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:10:55.244-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:10:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:11:25.377-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:11:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:11:55.648-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:11:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:12:25.927-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:12:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:12:56.208-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:12:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:13:02.337-0500 [conn1239] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T18:13:26.446-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:13:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:13:56.734-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:13:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:14:27.006-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:14:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:14:57.147-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:14:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:15:27.432-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:15:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:15:57.638-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:15:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:16:27.996-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:16:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:16:58.212-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:16:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:17:28.473-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:17:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:17:58.743-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:17:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:18:02.326-0500 [conn1240] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T18:18:28.947-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:18:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:18:59.273-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:18:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:19:29.523-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:19:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:19:59.814-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:19:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:20:30.094-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:20:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:21:00.486-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:21:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:21:30.789-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:21:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:22:01.096-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:22:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:22:31.387-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:22:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:23:01.579-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:23:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:23:02.276-0500 [conn1241] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T18:23:31.839-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:23:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:24:02.161-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:24:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:24:32.320-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:24:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:25:02.601-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:25:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:25:32.887-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:25:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:26:03.204-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:26:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:26:33.517-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:26:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:27:03.794-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:27:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:27:33.986-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:27:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:28:02.262-0500 [conn1242] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T18:28:04.173-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:28:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:28:34.465-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:28:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:29:04.750-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:29:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:29:35.168-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:29:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:30:05.429-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:30:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:30:35.573-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:30:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:31:05.843-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:31:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:31:36.111-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:31:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:32:06.397-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:32:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:32:36.652-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:32:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:33:06.867-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:33:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:33:32.210-0500 [conn1243] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T18:33:37.119-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:33:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:34:07.291-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:34:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:34:37.532-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:34:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:35:07.832-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:35:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:35:38.022-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:35:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:36:08.172-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:36:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:36:38.481-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:36:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:37:08.737-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:37:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:37:39.109-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:37:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:38:09.540-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:38:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:38:32.174-0500 [conn1244] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T18:38:39.838-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:38:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:39:10.125-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:39:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:39:40.382-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:39:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:40:10.647-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:40:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:40:40.930-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:40:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:41:11.161-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:41:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:41:41.492-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:41:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:42:11.829-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:42:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:42:42.012-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:42:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:43:12.305-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:43:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:43:32.273-0500 [conn1245] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T18:43:42.453-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:43:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:44:12.687-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:44:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:44:42.854-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:44:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:45:13.157-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:45:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:45:43.436-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:45:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:46:13.741-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:46:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:46:44.038-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:46:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:47:14.225-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:47:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:47:44.509-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:47:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:48:14.769-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:48:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:48:32.135-0500 [conn1246] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T18:48:45.045-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:48:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:49:15.198-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:49:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:49:45.507-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:49:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:50:15.712-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:50:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:50:45.969-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:50:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:51:16.202-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:51:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:51:46.572-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:51:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:52:16.893-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:52:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:52:47.198-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:52:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:53:17.502-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:53:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:53:32.283-0500 [conn1247] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T18:53:47.706-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:53:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:54:17.950-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:54:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:54:48.225-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:54:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:55:18.489-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:55:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:55:48.729-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:55:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:56:18.915-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:56:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:56:49.187-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:56:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:57:19.550-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:57:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:57:49.709-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:57:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:58:19.842-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:58:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:58:32.321-0500 [conn1248] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T18:58:50.012-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:58:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:59:20.293-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:59:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T18:59:50.568-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 18:59:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:00:20.845-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:00:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:00:51.158-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:00:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:01:21.288-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:01:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:01:51.506-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:01:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:02:21.763-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:02:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:02:52.057-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:02:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:03:22.284-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:03:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:03:32.233-0500 [conn1249] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T19:03:52.597-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:03:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:04:22.887-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:04:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:04:53.110-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:04:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:05:23.461-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:05:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:05:53.748-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:05:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:06:24.041-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:06:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:06:54.301-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:06:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:07:24.434-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:07:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:07:54.603-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:07:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:08:24.883-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:08:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:08:32.256-0500 [conn1250] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T19:08:55.158-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:08:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:09:25.417-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:09:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:09:55.786-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:09:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:10:25.948-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:10:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:10:56.110-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:10:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:11:26.463-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:11:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:11:56.609-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:11:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:12:26.883-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:12:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:12:57.041-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:12:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:13:27.212-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:13:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:13:32.135-0500 [conn1251] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T19:13:57.416-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:13:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:14:27.708-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:14:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:14:57.994-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:14:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:15:28.276-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:15:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:15:58.563-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:15:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:16:28.849-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:16:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:16:59.131-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:16:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:17:29.406-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:17:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:17:59.705-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:17:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:18:30.002-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:18:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:18:32.142-0500 [conn1252] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T19:19:00.268-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:19:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:19:30.555-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:19:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:20:00.789-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:20:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:20:30.946-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:20:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:21:01.414-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:21:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:21:31.691-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:21:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:22:02.029-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:22:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:22:32.400-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:22:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:23:02.671-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:23:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:23:32.198-0500 [conn1253] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T19:23:32.969-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:23:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:24:03.124-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:24:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:24:33.342-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:24:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:25:03.700-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:25:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:25:33.905-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:25:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:26:04.062-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:26:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:26:34.280-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:26:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:27:04.581-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:27:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:27:34.866-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:27:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:28:05.033-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:28:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:28:32.306-0500 [conn1254] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T19:28:35.480-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:28:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:29:05.795-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:29:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:29:36.122-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:29:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:30:06.424-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:30:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:30:36.656-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:30:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:31:06.856-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:31:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:31:37.043-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:31:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:32:07.188-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:32:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:32:37.322-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:32:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:33:07.606-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:33:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:33:32.253-0500 [conn1255] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T19:33:37.763-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:33:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:34:08.032-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:34:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:34:38.243-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:34:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:35:08.555-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:35:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:35:38.825-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:35:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:36:09.038-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:36:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:36:39.328-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:36:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:37:09.515-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:37:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:37:39.792-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:37:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:38:10.049-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:38:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:38:32.275-0500 [conn1256] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T19:38:40.390-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:38:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:39:10.690-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:39:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:39:40.995-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:39:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:40:11.286-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:40:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:40:41.563-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:40:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:41:11.703-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:41:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:41:42.004-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:41:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:42:12.521-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:42:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:42:42.968-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:42:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:43:13.104-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:43:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:43:32.191-0500 [conn1257] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T19:43:43.325-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:43:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:44:13.607-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:44:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:44:43.815-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:44:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:45:14.062-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:45:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:45:44.364-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:45:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:46:14.655-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:46:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:46:44.909-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:46:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:47:15.169-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:47:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:47:45.600-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:47:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:48:15.888-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:48:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:48:32.214-0500 [conn1258] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T19:48:46.267-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:48:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:49:16.526-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:49:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:49:46.867-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:49:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:50:17.178-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:50:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:50:47.449-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:50:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:51:17.727-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:51:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:51:48.131-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:51:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:52:18.408-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:52:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:52:48.766-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:52:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:53:18.965-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:53:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:53:32.146-0500 [conn1259] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T19:53:49.149-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:53:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:54:19.429-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:54:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:54:49.712-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:54:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:55:19.968-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:55:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:55:50.280-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:55:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:56:20.565-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:56:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:56:50.842-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:56:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:57:20.969-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:57:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:57:51.234-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:57:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:58:21.566-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:58:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:58:32.266-0500 [conn1260] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T19:58:51.834-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:58:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:59:22.036-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:59:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T19:59:52.383-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 19:59:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:00:22.662-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:00:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:00:53.033-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:00:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:01:23.326-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:01:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:01:53.556-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:01:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:02:23.845-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:02:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:02:54.264-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:02:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:03:24.636-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:03:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:03:32.364-0500 [conn1261] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T20:03:54.876-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:03:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:04:25.153-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:04:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:04:55.429-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:04:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:05:25.621-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:05:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:05:55.905-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:05:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:06:26.064-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:06:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:06:56.328-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:06:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:07:26.658-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:07:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:07:56.950-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:07:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:08:27.218-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:08:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:08:32.308-0500 [conn1262] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T20:08:57.493-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:08:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:09:27.766-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:09:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:09:58.062-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:09:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:10:28.255-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:10:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:10:58.481-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:10:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:11:28.775-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:11:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:11:59.062-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:11:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:12:29.325-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:12:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:12:59.599-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:12:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:13:29.894-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:13:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:13:32.226-0500 [conn1263] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T20:14:00.149-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:13:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:14:30.402-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:14:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:15:00.579-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:15:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:15:30.913-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:15:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:16:01.188-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:16:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:16:31.451-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:16:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:17:01.741-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:17:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:17:31.952-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:17:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:18:02.250-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:18:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:18:32.346-0500 [conn1264] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T20:18:32.393-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:18:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:19:02.655-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:19:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:19:32.971-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:19:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:20:03.248-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:20:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:20:33.389-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:20:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:21:03.680-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:21:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:21:33.978-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:21:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:22:04.233-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:22:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:22:34.461-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:22:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:23:04.622-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:23:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:23:32.297-0500 [conn1265] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T20:23:34.970-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:23:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:24:05.181-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:24:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:24:35.486-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:24:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:25:05.766-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:25:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:25:35.897-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:25:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:26:06.194-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:26:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:26:36.544-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:26:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:27:06.810-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:27:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:27:37.121-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:27:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:28:07.381-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:28:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:28:32.337-0500 [conn1266] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T20:28:37.668-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:28:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:29:07.875-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:29:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:29:38.140-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:29:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:30:08.451-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:30:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:30:38.746-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:30:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:31:08.937-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:31:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:31:39.217-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:31:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:32:09.473-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:32:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:32:39.736-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:32:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:33:10.012-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:33:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:33:32.196-0500 [conn1267] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T20:33:40.146-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:33:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:34:10.414-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:34:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:34:40.689-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:34:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:35:10.826-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:35:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:35:41.120-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:35:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:36:11.442-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:36:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:36:41.712-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:36:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:37:12.113-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:37:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:37:42.271-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:37:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:38:12.493-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:38:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:38:32.320-0500 [conn1268] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T20:38:42.678-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:38:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:39:12.971-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:39:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:39:43.223-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:39:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:40:13.501-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:40:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:40:43.811-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:40:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:41:14.077-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:41:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:41:44.438-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:41:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:42:14.705-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:42:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:42:45.122-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:42:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:43:15.413-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:43:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:43:32.333-0500 [conn1269] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T20:43:45.681-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:43:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:44:15.925-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:44:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:44:46.181-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:44:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:45:16.419-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:45:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:45:46.716-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:45:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:46:17.011-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:46:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:46:47.393-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:46:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:47:17.786-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:47:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:47:48.096-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:47:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:48:18.367-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:48:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:48:32.369-0500 [conn1270] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T20:48:48.696-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:48:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:49:18.946-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:49:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:49:49.269-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:49:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:50:19.458-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:50:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:50:49.736-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:50:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:51:19.927-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:51:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:51:50.116-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:51:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:52:20.402-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:52:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:52:50.691-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:52:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:53:21.043-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:53:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:53:32.347-0500 [conn1271] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T20:53:51.304-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:53:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:54:21.500-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:54:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:54:51.898-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:54:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:55:22.160-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:55:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:55:52.443-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:55:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:56:22.723-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:56:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:56:53.046-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:56:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:57:23.250-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:57:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:57:53.549-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:57:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:58:23.956-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:58:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:58:32.190-0500 [conn1272] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T20:58:54.238-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:58:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:59:24.494-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:59:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T20:59:54.761-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 20:59:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:00:25.043-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:00:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:00:55.336-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:00:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:01:25.611-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:01:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:01:55.932-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:01:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:02:26.233-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:02:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:02:56.511-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:02:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:03:26.820-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:03:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:03:32.194-0500 [conn1273] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T21:03:57.083-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:03:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:04:27.432-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:04:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:04:57.779-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:04:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:05:28.066-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:05:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:05:58.354-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:05:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:06:28.618-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:06:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:06:58.895-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:06:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:07:29.196-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:07:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:07:59.544-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:07:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:08:29.812-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:08:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:08:32.120-0500 [conn1274] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T21:09:00.113-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:08:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:09:30.443-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:09:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:10:00.680-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:10:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:10:30.860-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:10:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:11:01.263-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:11:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:11:31.563-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:11:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:12:01.823-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:12:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:12:32.095-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:12:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:13:02.470-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:13:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:13:32.173-0500 [conn1275] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T21:13:32.753-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:13:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:14:03.007-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:14:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:14:33.299-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:14:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:15:03.687-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:15:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:15:33.957-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:15:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:16:04.327-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:16:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:16:34.528-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:16:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:17:04.723-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:17:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:17:35.143-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:17:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:18:05.277-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:18:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:18:32.320-0500 [conn1276] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T21:18:35.453-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:18:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:19:05.677-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:19:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:19:36.004-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:19:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:20:06.263-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:20:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:20:36.559-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:20:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:21:06.815-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:21:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:21:36.962-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:21:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:22:07.230-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:22:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:22:37.503-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:22:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:23:07.875-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:23:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:23:32.423-0500 [conn1277] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T21:23:38.274-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:23:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:24:08.605-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:24:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:24:38.892-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:24:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:25:09.153-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:25:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:25:39.555-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:25:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:26:10.063-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:26:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:26:40.338-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:26:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:27:10.471-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:27:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:27:40.752-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:27:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:28:11.022-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:28:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:28:32.153-0500 [conn1278] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T21:28:41.155-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:28:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:29:11.441-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:29:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:29:41.759-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:29:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:30:11.951-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:30:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:30:42.211-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:30:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:31:12.619-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:31:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:31:42.856-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:31:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:32:13.143-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:32:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:32:43.476-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:32:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:33:13.753-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:33:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:33:32.198-0500 [conn1279] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T21:33:44.088-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:33:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:34:14.381-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:34:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:34:44.677-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:34:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:35:14.952-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:35:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:35:45.098-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:35:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:36:15.330-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:36:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:36:45.680-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:36:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:37:15.956-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:37:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:37:46.277-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:37:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:38:16.560-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:38:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:38:32.404-0500 [conn1280] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T21:38:46.808-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:38:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:39:16.975-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:39:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:39:47.309-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:39:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:40:17.461-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:40:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:40:47.731-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:40:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:41:18.021-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:41:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:41:48.396-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:41:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:42:18.654-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:42:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:42:48.912-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:42:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:43:19.345-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:43:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:43:32.267-0500 [conn1281] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T21:43:49.625-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:43:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:44:19.925-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:44:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:44:50.233-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:44:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:45:20.576-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:45:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:45:50.879-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:45:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:46:21.162-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:46:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:46:51.423-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:46:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:47:21.616-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:47:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:47:51.926-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:47:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:48:22.260-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:48:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:48:32.256-0500 [conn1282] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T21:48:52.659-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:48:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:49:22.943-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:49:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:49:53.230-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:49:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:50:23.429-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:50:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:50:53.761-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:50:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:51:24.041-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:51:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:51:54.313-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:51:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:52:24.588-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:52:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:52:54.863-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:52:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:53:25.118-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:53:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:53:32.315-0500 [conn1283] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T21:53:55.424-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:53:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:54:25.719-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:54:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:54:56.009-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:54:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:55:26.278-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:55:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:55:56.542-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:55:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:56:26.815-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:56:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:56:57.149-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:56:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:57:27.431-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:57:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:57:57.651-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:57:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:58:27.944-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:58:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:58:32.279-0500 [conn1284] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T21:58:58.106-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:58:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:59:28.465-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:59:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T21:59:58.635-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 21:59:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:00:28.919-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:00:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:00:59.149-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:00:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:01:29.447-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:01:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:01:59.751-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:01:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:02:29.929-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:02:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:03:00.210-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:02:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:03:30.468-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:03:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:03:32.353-0500 [conn1285] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T22:04:00.619-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:04:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:04:30.890-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:04:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:05:01.024-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:05:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:05:31.292-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:05:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:06:01.582-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:06:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:06:31.849-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:06:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:07:02.132-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:07:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:07:32.435-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:07:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:08:02.609-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:08:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:08:32.153-0500 [conn1286] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T22:08:32.837-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:08:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:09:02.987-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:09:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:09:33.304-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:09:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:10:03.627-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:10:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:10:33.895-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:10:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:11:04.147-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:11:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:11:34.492-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:11:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:12:04.771-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:12:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:12:35.029-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:12:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:13:05.302-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:13:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:13:32.321-0500 [conn1287] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T22:13:35.505-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:13:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:14:05.878-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:14:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:14:36.147-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:14:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:15:06.333-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:15:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:15:36.610-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:15:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:16:06.882-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:16:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:16:37.143-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:16:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:17:07.292-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:17:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:17:37.491-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:17:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:18:07.683-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:18:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:18:32.245-0500 [conn1288] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T22:18:38.004-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:18:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:19:08.256-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:19:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:19:38.542-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:19:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:20:08.811-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:20:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:20:39.003-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:20:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:21:09.291-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:21:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:21:39.625-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:21:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:22:09.878-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:22:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:22:40.273-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:22:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:23:10.563-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:23:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:23:32.218-0500 [conn1289] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T22:23:40.758-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:23:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:24:11.043-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:24:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:24:41.209-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:24:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:25:11.523-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:25:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:25:41.793-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:25:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:26:12.148-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:26:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:26:42.450-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:26:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:27:12.744-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:27:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:27:42.948-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:27:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:28:13.332-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:28:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:28:32.404-0500 [conn1290] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T22:28:43.694-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:28:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:29:13.934-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:29:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:29:44.300-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:29:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:30:14.475-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:30:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:30:44.863-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:30:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:31:15.141-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:31:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:31:45.422-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:31:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:32:15.666-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:32:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:32:46.067-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:32:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:33:16.210-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:33:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:33:32.167-0500 [conn1291] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T22:33:46.486-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:33:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:34:16.745-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:34:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:34:47.094-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:34:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:35:17.394-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:35:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:35:47.673-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:35:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:36:17.940-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:36:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:36:48.094-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:36:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:37:18.374-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:37:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:37:48.654-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:37:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:38:18.904-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:38:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:38:32.096-0500 [conn1292] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T22:38:49.164-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:38:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:39:19.482-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:39:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:39:49.688-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:39:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:40:19.966-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:40:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:40:50.371-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:40:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:41:20.644-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:41:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:41:50.878-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:41:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:42:21.153-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:42:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:42:51.478-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:42:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:43:21.614-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:43:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:43:32.173-0500 [conn1293] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T22:43:51.929-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:43:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:44:22.400-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:44:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:44:52.685-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:44:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:45:22.968-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:45:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:45:53.269-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:45:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:46:23.556-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:46:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:46:53.849-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:46:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:47:24.112-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:47:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:47:54.380-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:47:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:48:24.649-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:48:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:48:32.190-0500 [conn1294] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T22:48:54.971-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:48:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:49:25.130-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:49:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:49:55.266-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:49:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:50:25.539-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:50:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:50:55.875-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:50:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:51:26.202-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:51:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:51:56.510-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:51:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:52:26.783-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:52:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:52:56.950-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:52:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:53:27.339-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:53:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:53:32.305-0500 [conn1295] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T22:53:57.477-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:53:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:54:27.738-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:54:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:54:58.085-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:54:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:55:28.358-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:55:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:55:58.628-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:55:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:56:28.778-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:56:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:56:59.086-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:56:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:57:29.333-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:57:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:57:59.527-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:57:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:58:29.691-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:58:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:58:32.260-0500 [conn1296] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T22:58:59.999-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:58:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T22:59:30.293-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 22:59:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:00:00.634-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:00:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:00:30.859-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:00:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:01:01.118-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:01:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:01:31.405-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:01:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:02:01.690-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:02:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:02:31.952-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:02:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:03:02.167-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:03:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:03:32.314-0500 [conn1297] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T23:03:32.342-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:03:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:04:02.671-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:04:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:04:32.949-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:04:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:05:03.281-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:05:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:05:33.564-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:05:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:06:03.773-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:06:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:06:34.063-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:06:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:07:04.336-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:07:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:07:34.525-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:07:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:08:04.739-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:08:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:08:32.113-0500 [conn1298] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T23:08:35.039-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:08:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:09:05.322-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:09:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:09:35.593-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:09:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:10:05.763-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:10:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:10:35.999-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:10:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:11:06.296-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:11:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:11:36.553-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:11:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:12:06.851-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:12:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:12:37.043-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:12:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:13:07.191-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:13:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:13:32.192-0500 [conn1299] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T23:13:37.527-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:13:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:14:07.915-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:14:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:14:38.214-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:14:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:15:08.577-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:15:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:15:38.727-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:15:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:16:09.148-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:16:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:16:39.310-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:16:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:17:09.581-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:17:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:17:39.997-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:17:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:18:10.324-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:18:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:18:32.291-0500 [conn1300] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T23:18:40.498-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:18:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:19:10.732-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:19:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:19:41.007-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:19:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:20:11.197-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:20:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:20:41.373-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:20:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:21:11.731-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:21:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:21:42.015-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:21:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:22:12.288-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:22:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:22:42.593-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:22:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:23:12.883-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:23:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:23:32.152-0500 [conn1301] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T23:23:43.202-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:23:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:24:13.469-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:24:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:24:43.992-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:24:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:25:14.251-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:25:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:25:44.555-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:25:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:26:14.856-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:26:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:26:45.194-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:26:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:27:15.441-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:27:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:27:45.609-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:27:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:28:15.920-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:28:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:28:32.285-0500 [conn1302] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T23:28:46.311-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:28:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:29:16.598-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:29:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:29:46.980-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:29:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:30:17.179-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:30:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:30:47.368-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:30:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:31:17.703-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:31:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:31:47.986-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:31:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:32:18.137-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:32:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:32:48.421-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:32:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:33:18.716-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:33:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:33:32.227-0500 [conn1303] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T23:33:48.973-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:33:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:34:19.251-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:34:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:34:49.554-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:34:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:35:19.798-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:35:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:35:50.062-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:35:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:36:20.357-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:36:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:36:50.633-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:36:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:37:20.982-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:37:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:37:51.226-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:37:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:38:21.545-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:38:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:38:32.094-0500 [conn1304] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T23:38:51.804-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:38:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:39:22.086-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:39:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:39:52.308-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:39:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:40:22.657-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:40:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:40:53.008-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:40:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:41:23.296-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:41:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:41:53.599-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:41:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:42:23.745-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:42:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:42:54.002-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:42:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:43:24.274-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:43:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:43:32.300-0500 [conn1305] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T23:43:54.559-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:43:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:44:24.873-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:44:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:44:55.143-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:44:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:45:25.499-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:45:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:45:55.680-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:45:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:46:25.956-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:46:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:46:56.252-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:46:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:47:26.648-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:47:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:47:56.927-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:47:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:48:27.216-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:48:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:48:32.237-0500 [conn1306] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T23:48:57.496-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:48:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:49:27.766-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:49:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:49:58.067-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:49:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:50:28.493-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:50:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:50:58.705-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:50:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:51:29.021-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:51:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:51:59.304-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:51:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:52:29.721-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:52:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:52:59.858-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:52:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:53:30.050-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:53:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:53:32.215-0500 [conn1307] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T23:54:00.335-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:54:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:54:30.606-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:54:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:55:00.759-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:55:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:55:31.048-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:55:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:56:01.369-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:56:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:56:31.666-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:56:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:57:01.938-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:57:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:57:32.299-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:57:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:58:02.482-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:58:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:58:32.205-0500 [conn1308] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-26T23:58:32.749-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:58:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:59:02.945-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:59:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-26T23:59:33.286-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Thu Jan 26 23:59:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:00:03.564-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:00:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:00:08.088-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:00:08.088-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:00:32.596-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:00:32.596-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:00:33.805-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:00:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:00:38.787-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:00:38.787-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:01:03.239-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:01:03.239-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:01:04.150-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:01:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:01:15.492-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:01:15.492-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:01:34.490-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:01:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:01:52.010-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588ad43e9cf54f2f4edf0347') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485493311883), why: "doing balance round", ts: ObjectId('588ad43f9527cdec667c117b') } } gle1: { lastOp: Timestamp 1485493311000|22, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 32, writtenTo: null, err: null, waited: 32, ok: 1.0 } gle2: { lastOp: Timestamp 1485413996000|21, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 14, writtenTo: null, err: null, waited: 14, ok: 1.0 } 2017-01-27T00:01:52.021-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-27T00:01:52.155-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ad43f9527cdec667c117b 2017-01-27T00:01:52.788-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:01:59.122-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ad4469527cdec667c117c 2017-01-27T00:01:59.754-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:02:04.771-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:02:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:02:30.392-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ad4669527cdec667c117d 2017-01-27T00:02:31.053-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:02:35.046-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:02:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:02:43.536-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ad4739527cdec667c117e 2017-01-27T00:02:44.141-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:03:05.286-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:03:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:03:32.116-0500 [conn1309] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T00:03:35.563-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:03:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:04:05.880-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:04:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:04:09.473-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ad4c99527cdec667c117f 2017-01-27T00:04:10.246-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:04:16.582-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ad4d09527cdec667c1180 2017-01-27T00:04:17.249-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:04:36.103-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:04:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:05:06.486-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:05:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:05:30.348-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ad51a9527cdec667c1181 2017-01-27T00:05:30.979-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:05:36.729-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:05:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:05:37.332-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ad5219527cdec667c1182 2017-01-27T00:05:38.068-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:06:07.087-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:06:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:06:14.673-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:06:14.673-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:06:33.113-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ad5589527cdec667c1184 2017-01-27T00:06:33.779-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:06:37.365-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:06:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:06:58.340-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:06:58.340-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:07:07.639-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:07:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:07:10.580-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:07:10.580-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:07:35.202-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:07:35.202-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:07:37.847-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:07:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:08:08.151-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:08:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:08:23.895-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:08:23.895-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:08:32.318-0500 [conn1310] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T00:08:38.432-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:08:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:09:00.597-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:09:00.597-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:09:08.688-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:09:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:09:12.910-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:09:12.910-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:09:38.941-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:09:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:10:09.163-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:10:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:10:26.018-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:10:26.018-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:10:39.444-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:10:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:11:08.832-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ad66c9527cdec667c118c 2017-01-27T00:11:09.594-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:11:09.740-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:11:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:11:34.004-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:11:34.004-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:11:40.046-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:11:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:12:10.317-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:12:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:12:10.531-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:12:10.531-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:12:22.774-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588ad6b5d4047e5852d03528') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485493942658), why: "doing balance round", ts: ObjectId('588ad6b69527cdec667c118f') } } gle1: { lastOp: Timestamp 1485493869000|8, connectionId: 21778, updatedExisting: false, n: 0, syncMillis: 32, writtenTo: null, err: null, waited: 32, ok: 1.0 } gle2: { lastOp: Timestamp 1485493942000|14, connectionId: 6379656, updatedExisting: true, n: 1, syncMillis: 18, writtenTo: null, err: null, waited: 18, ok: 1.0 } 2017-01-27T00:12:22.786-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-27T00:12:22.917-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ad6b69527cdec667c118f 2017-01-27T00:12:23.617-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:12:40.568-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:12:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:13:10.842-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:13:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:13:12.443-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:13:12.443-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:13:32.205-0500 [conn1311] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T00:13:41.125-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:13:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:14:11.508-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:14:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:14:13.416-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:14:13.416-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:14:19.770-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ad72b9527cdec667c1192 2017-01-27T00:14:20.477-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:14:26.847-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ad7329527cdec667c1193 2017-01-27T00:14:27.591-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:14:41.787-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:14:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:14:45.977-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588ad744cf15934537a9f2e9') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485494085857), why: "doing balance round", ts: ObjectId('588ad7459527cdec667c1194') } } gle1: { lastOp: Timestamp 1485494085000|25, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 32, writtenTo: null, err: null, waited: 32, ok: 1.0 } gle2: { lastOp: Timestamp 1485494067000|19, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 9, writtenTo: null, err: null, waited: 9, ok: 1.0 } 2017-01-27T00:14:45.990-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-27T00:14:46.122-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ad7459527cdec667c1194 2017-01-27T00:14:46.796-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:14:59.182-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ad7529527cdec667c1195 2017-01-27T00:14:59.923-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:15:06.249-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ad7599527cdec667c1196 2017-01-27T00:15:07.046-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:15:11.952-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:15:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:15:42.206-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:15:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:15:49.766-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ad7859527cdec667c1197 2017-01-27T00:15:50.709-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:16:12.511-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:16:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:16:42.804-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:16:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:16:51.754-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ad7c39527cdec667c1198 2017-01-27T00:16:52.383-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:17:13.121-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:17:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:17:23.068-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:17:23.068-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:17:35.546-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ad7ef9527cdec667c119a 2017-01-27T00:17:36.205-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:17:43.405-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:17:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:18:12.956-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ad8149527cdec667c119b 2017-01-27T00:18:13.726-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:18:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:18:13.762-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:18:20.016-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ad81b9527cdec667c119c 2017-01-27T00:18:20.772-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:18:32.181-0500 [conn1312] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T00:18:44.007-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:18:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:19:14.180-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:19:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:19:44.485-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:19:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:20:14.703-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:20:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:20:34.458-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:20:34.458-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:20:44.934-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:20:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:21:15.081-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:21:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:21:29.218-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:21:29.218-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:21:35.418-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:21:35.418-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:21:45.410-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:21:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:22:15.752-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:22:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:22:46.144-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:22:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:22:48.538-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:22:48.538-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:23:00.859-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:23:00.859-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:23:16.431-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:23:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:23:32.226-0500 [conn1313] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T00:23:46.719-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:23:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:23:55.656-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:23:55.656-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:24:17.042-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:24:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:24:47.426-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:24:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:25:17.582-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:25:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:25:47.937-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:25:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:26:18.105-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:26:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:26:48.392-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:26:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:27:18.554-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:27:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:27:22.402-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588ada396dca7bf37970c85d') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485494842275), why: "doing balance round", ts: ObjectId('588ada3a9527cdec667c11a3') } } gle1: { lastOp: Timestamp 1485494842000|22, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 33, writtenTo: null, err: null, waited: 33, ok: 1.0 } gle2: { lastOp: Timestamp 1485494300000|33, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 2, writtenTo: null, err: null, waited: 2, ok: 1.0 } 2017-01-27T00:27:22.499-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-27T00:27:22.656-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ada3a9527cdec667c11a3 2017-01-27T00:27:23.356-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:27:35.585-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588ada465a2c915f7c2ca14a') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485494855484), why: "doing balance round", ts: ObjectId('588ada479527cdec667c11a4') } } gle1: { lastOp: Timestamp 1485494855000|9, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 13, writtenTo: null, err: null, waited: 13, ok: 1.0 } gle2: { lastOp: Timestamp 1485494843000|4, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 13, writtenTo: null, err: null, waited: 13, ok: 1.0 } 2017-01-27T00:27:35.594-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-27T00:27:35.595-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:27:48.691-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:27:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:27:48.691-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-27T00:27:48.768-0500 [LockPinger] handled late remove of old distributed lock with ts 588ada479527cdec667c11a4 2017-01-27T00:28:00.115-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ada5f9527cdec667c11a5 2017-01-27T00:28:00.772-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:28:18.984-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:28:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:28:19.308-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ada739527cdec667c11a6 2017-01-27T00:28:20.048-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:28:32.152-0500 [conn1314] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T00:28:44.601-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ada8c9527cdec667c11a7 2017-01-27T00:28:45.266-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:28:49.266-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:28:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:29:19.545-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:29:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:29:49.773-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:29:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:29:58.196-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588adad5f2367042e84ec601') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485494998091), why: "doing balance round", ts: ObjectId('588adad69527cdec667c11a8') } } gle1: { lastOp: Timestamp 1485494998000|6, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 2, writtenTo: null, err: null, waited: 2, ok: 1.0 } gle2: { lastOp: Timestamp 1485494925000|7, connectionId: 393608, updatedExisting: false, n: 0, syncMillis: 13, writtenTo: null, err: null, waited: 13, ok: 1.0 } 2017-01-27T00:29:58.205-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-27T00:29:58.305-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588adad69527cdec667c11a8 2017-01-27T00:29:59.009-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:30:20.196-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:30:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:30:23.418-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:30:23.418-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:30:47.833-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:30:47.833-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:30:50.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:30:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:31:20.734-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:31:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:31:24.353-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:31:24.353-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:31:48.836-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:31:48.836-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:31:51.085-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:31:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:32:01.097-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:32:01.097-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:32:21.361-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:32:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:32:51.688-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:32:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:33:22.067-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:33:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:33:32.449-0500 [conn1315] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T00:33:38.704-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:33:38.704-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:33:52.337-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:33:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:33:57.017-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:33:57.017-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:34:22.531-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:34:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:34:52.842-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:34:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:34:58.018-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588adc019527cdec667c11b0 2017-01-27T00:34:58.684-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:35:05.035-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588adc089527cdec667c11b1 2017-01-27T00:35:05.704-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:35:11.958-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:35:11.959-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:35:23.133-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:35:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:35:24.377-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588adc1c9527cdec667c11b3 2017-01-27T00:35:25.087-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:35:53.599-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:35:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:35:55.658-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588adc3b9527cdec667c11b4 2017-01-27T00:35:56.320-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:36:20.805-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:36:20.805-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:36:23.936-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:36:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:36:54.233-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:36:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:37:21.951-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:37:21.951-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:37:24.531-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:37:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:37:54.820-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:37:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:38:04.583-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:38:04.583-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:38:25.151-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:38:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:38:32.318-0500 [conn1316] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T00:38:55.443-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:38:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:39:17.576-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:39:17.576-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:39:25.603-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:39:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:39:48.026-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588add236c5ff41b714bd9ea') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485495587901), why: "doing balance round", ts: ObjectId('588add239527cdec667c11b9') } } gle1: { lastOp: Timestamp 1485495587000|32, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 24, writtenTo: null, err: null, waited: 24, ok: 1.0 } gle2: { lastOp: Timestamp 1485495356000|6, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 19, writtenTo: null, err: null, waited: 19, ok: 1.0 } 2017-01-27T00:39:48.057-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-27T00:39:48.207-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588add239527cdec667c11b9 2017-01-27T00:39:48.874-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:39:55.895-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:39:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:40:01.459-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588add319527cdec667c11ba 2017-01-27T00:40:02.203-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:40:26.115-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:40:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:40:56.390-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:40:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:41:03.191-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:41:03.191-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:41:15.524-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:41:15.524-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:41:26.687-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:41:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:41:40.094-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:41:40.094-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:41:56.982-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:41:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:42:27.262-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:42:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:42:57.410-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:42:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:43:27.556-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:43:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:43:32.254-0500 [conn1317] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T00:43:57.878-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:43:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:44:28.119-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:44:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:44:58.373-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:44:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:45:28.685-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:45:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:45:37.134-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:45:37.134-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:45:43.479-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ade879527cdec667c11bf 2017-01-27T00:45:44.101-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:45:58.964-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:45:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:46:26.850-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588adeb29527cdec667c11c0 2017-01-27T00:46:27.586-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:46:29.159-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:46:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:46:46.067-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588adec59527cdec667c11c1 2017-01-27T00:46:46.836-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:46:59.298-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:46:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:47:23.567-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:47:23.567-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:47:29.448-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:47:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:47:29.983-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588adef19527cdec667c11c3 2017-01-27T00:47:30.585-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:47:42.911-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588adefe9527cdec667c11c4 2017-01-27T00:47:43.542-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:47:49.871-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588adf059527cdec667c11c5 2017-01-27T00:47:50.505-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:47:59.623-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:47:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:48:29.887-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:48:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:48:32.333-0500 [conn1318] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T00:49:00.158-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:48:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:49:03.772-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588adf4f9527cdec667c11c6 2017-01-27T00:49:04.373-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:49:28.946-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588adf689527cdec667c11c7 2017-01-27T00:49:29.614-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:49:30.424-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:49:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:49:48.115-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588adf7b9527cdec667c11c8 2017-01-27T00:49:48.863-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:50:00.601-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:50:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:50:19.416-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:50:19.416-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:50:25.769-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588adfa19527cdec667c11ca 2017-01-27T00:50:26.568-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:50:30.871-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:50:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:50:57.147-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:50:57.147-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:51:01.075-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:51:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:51:27.861-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:51:27.861-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:51:31.367-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:51:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:51:46.311-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588adff29527cdec667c11cd 2017-01-27T00:51:47.048-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:51:59.408-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588adfff9527cdec667c11ce 2017-01-27T00:52:00.184-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:52:01.733-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:52:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:52:24.767-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ae0189527cdec667c11cf 2017-01-27T00:52:25.507-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:52:31.913-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:52:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:53:02.199-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:53:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:53:08.323-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:53:08.323-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:53:32.201-0500 [conn1319] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T00:53:32.498-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:53:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:54:02.862-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:54:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:54:27.358-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:54:27.358-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:54:33.047-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:54:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:54:39.662-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:54:39.662-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:55:03.218-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:55:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:55:28.268-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:55:28.268-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:55:33.560-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:55:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:55:58.981-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:55:58.981-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:56:03.826-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:56:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:56:23.484-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:56:23.484-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:56:34.223-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:56:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:56:48.018-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588ae11eb081817bb2461ebf') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485496607892), why: "doing balance round", ts: ObjectId('588ae11f9527cdec667c11d6') } } gle1: { lastOp: Timestamp 1485496607000|42, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 35, writtenTo: null, err: null, waited: 35, ok: 1.0 } gle2: { lastOp: Timestamp 1485496345000|9, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 6, writtenTo: null, err: null, waited: 6, ok: 1.0 } 2017-01-27T00:56:48.029-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-27T00:56:48.162-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ae11f9527cdec667c11d6 2017-01-27T00:56:48.831-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:57:04.511-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:57:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:57:13.416-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:57:13.416-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:57:19.784-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ae13f9527cdec667c11d8 2017-01-27T00:57:20.455-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:57:26.814-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ae1469527cdec667c11d9 2017-01-27T00:57:27.554-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:57:34.933-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:57:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:57:52.123-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ae15f9527cdec667c11da 2017-01-27T00:57:52.715-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:58:05.082-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:58:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:58:32.295-0500 [conn1320] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T00:58:35.394-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:58:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:58:35.574-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T00:58:35.574-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T00:59:05.664-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:59:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T00:59:06.269-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ae1a99527cdec667c11dc 2017-01-27T00:59:06.933-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:59:25.522-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ae1bd9527cdec667c11dd 2017-01-27T00:59:26.180-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:59:32.415-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ae1c49527cdec667c11de 2017-01-27T00:59:33.088-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T00:59:35.956-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 00:59:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:00:06.232-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:00:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:00:36.460-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:00:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:01:06.696-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:01:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:01:28.769-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:01:28.769-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:01:34.969-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:01:34.970-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:01:37.012-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:01:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:02:07.203-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:02:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:02:37.442-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:02:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:03:07.748-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:03:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:03:18.493-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:03:18.493-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:03:32.263-0500 [conn1321] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T01:03:37.894-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:03:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:04:08.151-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:04:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:04:38.432-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:04:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:04:49.786-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588ae300e6f83b6d553cea3b') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485497089673), why: "doing balance round", ts: ObjectId('588ae3019527cdec667c11e2') } } gle1: { lastOp: Timestamp 1485497089000|22, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 32, writtenTo: null, err: null, waited: 32, ok: 1.0 } gle2: { lastOp: Timestamp 1485496773000|2, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 17, writtenTo: null, err: null, waited: 17, ok: 1.0 } 2017-01-27T01:04:49.796-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-27T01:04:49.932-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ae3019527cdec667c11e2 2017-01-27T01:04:50.673-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:04:57.045-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ae3089527cdec667c11e3 2017-01-27T01:04:57.641-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:05:08.709-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:05:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:05:28.349-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ae3279527cdec667c11e4 2017-01-27T01:05:28.972-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:05:39.113-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:05:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:06:09.341-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:06:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:06:39.759-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:06:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:06:48.219-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ae3789527cdec667c11e5 2017-01-27T01:06:49.024-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:07:10.014-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:07:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:07:40.192-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:07:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:08:10.498-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:08:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:08:32.153-0500 [conn1322] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T01:08:40.779-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:08:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:08:50.574-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588ae3f1817863dd8c022fd7') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485497330428), why: "doing balance round", ts: ObjectId('588ae3f29527cdec667c11e6') } } gle1: { lastOp: Timestamp 1485497330000|10, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 25, writtenTo: null, err: null, waited: 25, ok: 1.0 } gle2: { lastOp: Timestamp 1485497208000|22, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 21, writtenTo: null, err: null, waited: 21, ok: 1.0 } 2017-01-27T01:08:50.580-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-27T01:08:50.580-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:09:08.930-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:09:08.930-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:09:10.972-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:09:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:09:10.972-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-27T01:09:11.043-0500 [LockPinger] handled late remove of old distributed lock with ts 588ae3f29527cdec667c11e6 2017-01-27T01:09:27.400-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ae4179527cdec667c11e8 2017-01-27T01:09:28.069-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:09:41.316-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:09:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:09:46.562-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ae42a9527cdec667c11e9 2017-01-27T01:09:47.191-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:10:11.544-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:10:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:10:41.805-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:10:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:10:42.014-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588ae461d4047e5852d03599') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485497441833), why: "doing balance round", ts: ObjectId('588ae4619527cdec667c11ea') } } gle1: { lastOp: Timestamp 1485497441000|37, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 4, writtenTo: null, err: null, waited: 4, ok: 1.0 } gle2: { lastOp: Timestamp 1485497387000|5, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 32, writtenTo: null, err: null, waited: 32, ok: 1.0 } 2017-01-27T01:10:42.025-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-27T01:10:42.129-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ae4619527cdec667c11ea 2017-01-27T01:10:42.862-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:11:12.177-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:11:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:11:19.515-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:11:19.515-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:11:42.449-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:11:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:11:50.119-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ae4a59527cdec667c11ec 2017-01-27T01:11:50.859-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:11:57.101-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:11:57.101-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:12:12.587-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:12:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:12:15.698-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:12:15.698-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:12:27.975-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:12:27.975-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:12:42.851-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:12:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:12:52.388-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:12:52.388-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:13:13.055-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:13:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:13:32.162-0500 [conn1323] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T01:13:43.227-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:13:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:13:53.547-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ae5219527cdec667c11f1 2017-01-27T01:13:54.248-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:14:13.614-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:14:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:14:43.130-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ae5529527cdec667c11f2 2017-01-27T01:14:43.768-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:14:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:14:43.840-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:15:08.386-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588ae56b89b67e1cf674ca08') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485497708176), why: "doing balance round", ts: ObjectId('588ae56c9527cdec667c11f3') } } gle1: { lastOp: Timestamp 1485497683000|25, connectionId: 21778, updatedExisting: false, n: 0, syncMillis: 16, writtenTo: null, err: null, waited: 16, ok: 1.0 } gle2: { lastOp: Timestamp 1485497708000|7, connectionId: 6379656, updatedExisting: true, n: 1, syncMillis: 33, writtenTo: null, err: null, waited: 33, ok: 1.0 } 2017-01-27T01:15:08.392-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-27T01:15:08.392-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:15:14.099-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:15:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:15:14.099-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-27T01:15:14.240-0500 [LockPinger] handled late remove of old distributed lock with ts 588ae56c9527cdec667c11f3 2017-01-27T01:15:14.602-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:15:14.602-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:15:44.614-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:15:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:16:14.902-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:16:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:16:45.287-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:16:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:16:45.795-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588ae5cce6f83b6d553cea50') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485497805649), why: "doing balance round", ts: ObjectId('588ae5cd9527cdec667c11f5') } } gle1: { lastOp: Timestamp 1485497683000|25, connectionId: 21778, updatedExisting: false, n: 0, syncMillis: 21, writtenTo: null, err: null, waited: 21, ok: 1.0 } gle2: { lastOp: Timestamp 1485497805000|27, connectionId: 6379656, updatedExisting: true, n: 1, syncMillis: 24, writtenTo: null, err: null, waited: 24, ok: 1.0 } 2017-01-27T01:16:45.806-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-27T01:16:45.939-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ae5cd9527cdec667c11f5 2017-01-27T01:16:46.615-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:16:59.104-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ae5da9527cdec667c11f6 2017-01-27T01:16:59.731-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:17:12.067-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ae5e79527cdec667c11f7 2017-01-27T01:17:12.691-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:17:15.441-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:17:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:17:31.256-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ae5fa9527cdec667c11f8 2017-01-27T01:17:31.977-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:17:45.601-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:17:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:18:15.781-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:18:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:18:32.247-0500 [conn1324] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T01:18:44.975-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ae6449527cdec667c11f9 2017-01-27T01:18:45.536-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:18:46.067-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:18:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:18:51.899-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ae64b9527cdec667c11fa 2017-01-27T01:18:52.596-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:19:16.418-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:19:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:19:29.331-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ae6719527cdec667c11fb 2017-01-27T01:19:30.001-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:19:46.738-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:19:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:19:54.462-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:19:54.462-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:20:06.691-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:20:06.691-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:20:17.048-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:20:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:20:24.965-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:20:24.966-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:20:47.435-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:20:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:21:17.845-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:21:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:21:37.952-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:21:37.952-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:21:48.170-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:21:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:21:50.294-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:21:50.294-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:22:18.445-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:22:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:22:48.865-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:22:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:22:51.234-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ae73a9527cdec667c1201 2017-01-27T01:22:51.908-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:22:58.128-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ae7419527cdec667c1202 2017-01-27T01:22:58.753-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:23:19.209-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:23:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:23:29.323-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:23:29.323-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:23:32.181-0500 [conn1325] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T01:23:49.493-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:23:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:24:12.132-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ae78b9527cdec667c1204 2017-01-27T01:24:12.796-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:24:19.760-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:24:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:24:43.393-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ae7ab9527cdec667c1205 2017-01-27T01:24:44.183-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:24:50.081-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:24:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:24:56.467-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:24:56.467-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:25:08.995-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ae7c49527cdec667c1207 2017-01-27T01:25:09.770-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:25:20.412-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:25:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:25:40.298-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ae7e49527cdec667c1208 2017-01-27T01:25:40.920-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:25:50.806-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:25:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:25:53.314-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588ae7f0ca3906e0a9d42593') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485498353071), why: "doing balance round", ts: ObjectId('588ae7f19527cdec667c1209') } } gle1: { lastOp: Timestamp 1485498353000|6, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 14, writtenTo: null, err: null, waited: 14, ok: 1.0 } gle2: { lastOp: Timestamp 1485498340000|17, connectionId: 393608, updatedExisting: false, n: 0, syncMillis: 23, writtenTo: null, err: null, waited: 23, ok: 1.0 } 2017-01-27T01:25:53.322-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-27T01:25:53.322-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:26:21.085-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:26:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:26:21.085-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-27T01:26:21.216-0500 [LockPinger] handled late remove of old distributed lock with ts 588ae7f19527cdec667c1209 2017-01-27T01:26:48.204-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:26:48.204-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:26:51.588-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:26:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:27:12.592-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:27:12.593-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:27:21.761-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:27:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:27:24.945-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:27:24.945-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:27:43.413-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:27:43.413-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:27:51.929-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:27:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:28:13.873-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:28:13.873-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:28:22.113-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:28:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:28:32.226-0500 [conn1326] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T01:28:50.415-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:28:50.415-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:28:52.463-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:28:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:29:22.788-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:29:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:29:51.681-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ae8df9527cdec667c1210 2017-01-27T01:29:52.370-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:29:53.045-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:29:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:30:16.977-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ae8f89527cdec667c1211 2017-01-27T01:30:17.710-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:30:23.307-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:30:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:30:36.274-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ae90b9527cdec667c1212 2017-01-27T01:30:36.936-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:30:53.603-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:30:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:31:01.344-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ae9259527cdec667c1213 2017-01-27T01:31:02.043-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:31:08.272-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:31:08.272-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:31:14.469-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:31:14.469-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:31:23.878-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:31:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:31:51.052-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:31:51.052-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:31:54.162-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:31:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:32:24.316-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:32:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:32:54.583-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:32:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:33:10.132-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:33:10.132-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:33:24.925-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:33:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:33:32.154-0500 [conn1327] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T01:33:55.114-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:33:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:34:10.984-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588ae9e193e79d5cc6df28ad') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485498850828), why: "doing balance round", ts: ObjectId('588ae9e29527cdec667c1218') } } gle1: { lastOp: Timestamp 1485498850000|31, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 16, writtenTo: null, err: null, waited: 16, ok: 1.0 } gle2: { lastOp: Timestamp 1485498662000|1, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 8, writtenTo: null, err: null, waited: 8, ok: 1.0 } 2017-01-27T01:34:10.991-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-27T01:34:10.991-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:34:23.298-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:34:23.298-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:34:25.342-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:34:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:34:25.342-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-27T01:34:25.485-0500 [LockPinger] handled late remove of old distributed lock with ts 588ae9e29527cdec667c1218 2017-01-27T01:34:41.634-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:34:41.634-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:34:55.635-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:34:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:35:25.811-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:35:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:35:54.953-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:35:54.953-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:35:56.012-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:35:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:36:01.345-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588aea519527cdec667c121c 2017-01-27T01:36:02.060-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:36:08.332-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588aea589527cdec667c121d 2017-01-27T01:36:09.144-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:36:26.196-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:36:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:36:27.513-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:36:27.513-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:36:39.766-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:36:39.766-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:36:56.446-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:36:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:37:26.636-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:37:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:37:56.886-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:37:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:38:27.081-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:38:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:38:32.234-0500 [conn1328] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T01:38:41.386-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:38:41.386-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:38:57.321-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:38:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:38:59.848-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:38:59.848-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:39:27.685-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:39:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:39:42.631-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:39:42.631-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:39:57.853-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:39:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:40:13.104-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588aeb4c761cca343eeb541a') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485499212972), why: "doing balance round", ts: ObjectId('588aeb4c9527cdec667c1223') } } gle1: { lastOp: Timestamp 1485499213000|3, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 31, writtenTo: null, err: null, waited: 31, ok: 1.0 } gle2: { lastOp: Timestamp 1485498969000|4, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 8, writtenTo: null, err: null, waited: 8, ok: 1.0 } 2017-01-27T01:40:13.114-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-27T01:40:13.250-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588aeb4c9527cdec667c1223 2017-01-27T01:40:13.897-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:40:28.154-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:40:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:40:32.623-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588aeb609527cdec667c1224 2017-01-27T01:40:33.302-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:40:39.840-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588aeb679527cdec667c1225 2017-01-27T01:40:40.715-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:40:58.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:40:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:40:59.155-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:40:59.155-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:41:28.835-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:41:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:41:59.120-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:41:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:42:12.137-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:42:12.138-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:42:29.394-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:42:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:42:36.567-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:42:36.567-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:42:59.732-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:42:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:43:01.034-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:43:01.034-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:43:29.986-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:43:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:43:32.159-0500 [conn1329] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T01:43:43.704-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:43:43.704-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:44:00.147-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:43:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:44:08.076-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:44:08.076-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:44:30.464-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:44:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:44:44.811-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:44:44.811-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:44:57.177-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:44:57.177-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:45:00.650-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:45:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:45:03.317-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588aec6e62e531ebd966cf91') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485499503236), why: "doing balance round", ts: ObjectId('588aec6f9527cdec667c122e') } } gle1: { lastOp: Timestamp 1485499240000|11, connectionId: 21778, updatedExisting: false, n: 0, syncMillis: 1, writtenTo: null, err: null, waited: 1, ok: 1.0 } gle2: { lastOp: Timestamp 1485499503000|6, connectionId: 393608, updatedExisting: true, n: 1, syncMillis: 10, writtenTo: null, err: null, waited: 10, ok: 1.0 } 2017-01-27T01:45:03.327-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-27T01:45:03.461-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588aec6f9527cdec667c122e 2017-01-27T01:45:04.271-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:45:30.838-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:45:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:45:34.914-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588aec8e9527cdec667c122f 2017-01-27T01:45:35.484-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:46:01.167-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:46:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:46:06.240-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588aecad9527cdec667c1230 2017-01-27T01:46:06.872-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:46:31.514-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588aecc79527cdec667c1231 2017-01-27T01:46:31.604-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:46:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:46:32.274-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:47:01.940-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:47:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:47:02.904-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588aece69527cdec667c1232 2017-01-27T01:47:03.682-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:47:32.245-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:47:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:47:58.567-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588aed1e9527cdec667c1233 2017-01-27T01:47:59.198-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:48:02.556-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:48:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:48:32.110-0500 [conn1330] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T01:48:32.879-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:48:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:49:03.071-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:49:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:49:06.258-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588aed619527cdec667c1234 2017-01-27T01:49:06.985-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:49:13.346-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588aed699527cdec667c1235 2017-01-27T01:49:14.151-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:49:20.319-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588aed6f71cefcc8ddba9208') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485499760211), why: "doing balance round", ts: ObjectId('588aed709527cdec667c1236') } } gle1: { lastOp: Timestamp 1485499754000|2, connectionId: 21778, updatedExisting: false, n: 0, syncMillis: 15, writtenTo: null, err: null, waited: 15, ok: 1.0 } gle2: { lastOp: Timestamp 1485499760000|7, connectionId: 6379656, updatedExisting: true, n: 1, syncMillis: 10, writtenTo: null, err: null, waited: 10, ok: 1.0 } 2017-01-27T01:49:20.330-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-27T01:49:20.395-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588aed709527cdec667c1236 2017-01-27T01:49:21.135-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:49:27.597-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588aed779527cdec667c1237 2017-01-27T01:49:28.367-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:49:33.349-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:49:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:49:34.747-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588aed7e9527cdec667c1238 2017-01-27T01:49:35.467-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:50:03.582-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:50:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:50:24.189-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588aedaf9527cdec667c1239 2017-01-27T01:50:24.824-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:50:31.207-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588aedb69527cdec667c123a 2017-01-27T01:50:31.837-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:50:33.899-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:50:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:51:04.209-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:51:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:51:34.512-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:51:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:52:03.374-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588aee139527cdec667c123b 2017-01-27T01:52:04.179-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:52:04.785-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:52:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:52:22.689-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588aee269527cdec667c123c 2017-01-27T01:52:23.318-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:52:35.124-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:52:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:52:41.801-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588aee399527cdec667c123d 2017-01-27T01:52:42.542-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:53:01.261-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588aee4c9527cdec667c123e 2017-01-27T01:53:01.958-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:53:05.329-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:53:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:53:32.140-0500 [conn1331] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T01:53:32.571-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:53:32.571-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:53:35.646-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:53:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:53:56.999-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:53:56.999-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:54:05.845-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:54:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:54:36.133-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:54:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:54:39.590-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:54:39.590-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:54:45.928-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:54:45.928-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:55:06.340-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:55:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:55:36.499-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:55:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:56:06.771-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:56:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:56:36.971-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:56:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:57:07.208-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:57:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:57:37.498-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:57:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:58:07.792-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:58:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:58:12.595-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:58:12.595-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:58:18.978-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588aef8a9527cdec667c1244 2017-01-27T01:58:19.617-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T01:58:32.146-0500 [conn1332] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T01:58:38.108-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:58:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:58:43.976-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:58:43.976-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:59:08.376-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:59:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:59:27.303-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:59:27.303-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:59:38.662-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 01:59:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T01:59:45.670-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-27T01:59:45.670-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-27T01:59:57.858-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588aefebcf5c96e0124faff7') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485500397787), why: "doing balance round", ts: ObjectId('588aefed9527cdec667c1248') } } gle1: { lastOp: Timestamp 1485500397000|10, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 14, writtenTo: null, err: null, waited: 14, ok: 1.0 } gle2: { lastOp: Timestamp 1485500299000|13, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 3, writtenTo: null, err: null, waited: 3, ok: 1.0 } 2017-01-27T01:59:57.867-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-27T01:59:57.932-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588aefed9527cdec667c1248 2017-01-27T01:59:58.665-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-27T02:00:08.973-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:00:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:00:39.242-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:00:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:01:09.531-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:01:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:01:39.728-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:01:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:02:09.878-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:02:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:02:40.115-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:02:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:03:10.374-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:03:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:03:32.174-0500 [conn1333] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T02:03:40.659-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:03:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:04:11.007-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:04:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:04:41.426-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:04:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:05:11.897-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:05:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:05:42.384-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:05:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:06:12.611-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:06:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:06:42.992-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:06:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:07:13.272-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:07:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:07:43.441-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:07:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:08:13.700-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:08:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:08:32.306-0500 [conn1334] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T02:08:43.974-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:08:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:09:14.225-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:09:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:09:44.412-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:09:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:10:14.596-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:10:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:10:44.873-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:10:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:11:15.288-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:11:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:11:45.577-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:11:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:12:15.858-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:12:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:12:46.012-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:12:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:13:16.297-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:13:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:13:32.308-0500 [conn1335] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T02:13:46.604-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:13:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:14:17.013-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:14:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:14:47.215-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:14:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:15:17.503-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:15:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:15:47.767-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:15:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:16:17.990-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:16:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:16:48.134-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:16:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:17:18.485-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:17:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:17:48.756-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:17:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:18:18.964-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:18:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:18:32.153-0500 [conn1336] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T02:18:49.253-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:18:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:19:19.452-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:19:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:19:49.726-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:19:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:20:19.889-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:20:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:20:50.175-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:20:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:21:20.571-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:21:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:21:50.722-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:21:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:22:21.099-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:22:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:22:51.358-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:22:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:23:21.629-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:23:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:23:32.115-0500 [conn1337] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T02:23:51.932-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:23:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:24:22.207-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:24:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:24:52.453-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:24:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:25:22.600-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:25:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:25:52.879-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:25:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:26:23.156-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:26:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:26:53.436-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:26:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:27:23.723-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:27:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:27:53.986-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:27:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:28:24.268-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:28:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:28:32.207-0500 [conn1338] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T02:28:54.429-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:28:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:29:24.842-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:29:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:29:55.078-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:29:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:30:25.369-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:30:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:30:55.632-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:30:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:31:25.900-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:31:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:31:56.182-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:31:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:32:26.463-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:32:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:32:56.723-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:32:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:33:27.017-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:33:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:33:32.310-0500 [conn1339] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T02:33:57.389-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:33:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:34:27.670-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:34:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:34:57.994-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:34:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:35:28.277-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:35:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:35:58.592-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:35:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:36:28.730-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:36:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:36:59.021-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:36:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:37:29.314-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:37:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:37:59.825-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:37:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:38:30.106-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:38:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:38:32.242-0500 [conn1340] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T02:39:00.383-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:39:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:39:30.685-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:39:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:40:00.992-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:40:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:40:31.356-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:40:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:41:01.672-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:41:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:41:31.883-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:41:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:42:02.246-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:42:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:42:32.561-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:42:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:43:02.703-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:43:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:43:32.179-0500 [conn1341] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T02:43:33.036-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:43:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:44:03.306-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:44:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:44:33.589-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:44:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:45:03.848-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:45:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:45:34.139-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:45:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:46:04.414-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:46:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:46:34.692-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:46:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:47:05.027-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:47:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:47:35.273-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:47:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:48:05.445-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:48:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:48:32.281-0500 [conn1342] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T02:48:35.656-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:48:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:49:05.942-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:49:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:49:36.228-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:49:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:50:06.398-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:50:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:50:36.592-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:50:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:51:06.897-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:51:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:51:37.279-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:51:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:52:07.552-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:52:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:52:37.894-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:52:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:53:08.229-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:53:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:53:32.145-0500 [conn1343] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T02:53:38.517-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:53:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:54:08.828-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:54:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:54:38.970-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:54:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:55:09.105-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:55:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:55:39.359-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:55:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:56:09.709-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:56:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:56:39.986-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:56:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:57:10.244-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:57:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:57:40.609-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:57:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:58:10.940-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:58:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:58:32.145-0500 [conn1344] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T02:58:41.228-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:58:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:59:11.511-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:59:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T02:59:41.765-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 02:59:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:00:12.165-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:00:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:00:42.470-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:00:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:01:12.939-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:01:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:01:43.250-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:01:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:02:13.511-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:02:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:02:43.726-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:02:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:03:13.921-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:03:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:03:32.085-0500 [conn1345] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T03:03:44.139-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:03:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:04:14.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:04:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:04:44.708-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:04:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:05:14.999-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:05:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:05:45.271-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:05:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:06:15.458-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:06:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:06:45.849-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:06:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:07:16.008-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:07:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:07:46.160-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:07:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:08:16.479-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:08:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:08:32.179-0500 [conn1346] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T03:08:46.608-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:08:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:09:16.927-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:09:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:09:47.300-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:09:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:10:17.595-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:10:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:10:47.881-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:10:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:11:18.130-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:11:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:11:48.382-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:11:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:12:18.760-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:12:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:12:49.052-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:12:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:13:19.381-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:13:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:13:32.147-0500 [conn1347] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T03:13:49.631-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:13:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:14:19.919-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:14:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:14:50.204-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:14:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:15:20.464-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:15:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:15:50.817-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:15:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:16:21.100-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:16:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:16:51.361-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:16:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:17:21.498-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:17:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:17:51.688-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:17:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:18:21.977-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:18:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:18:32.145-0500 [conn1348] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T03:18:52.290-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:18:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:19:22.540-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:19:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:19:52.789-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:19:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:20:23.080-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:20:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:20:53.344-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:20:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:21:23.619-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:21:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:21:53.948-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:21:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:22:24.125-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:22:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:22:54.375-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:22:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:23:24.655-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:23:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:23:32.176-0500 [conn1349] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T03:23:54.929-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:23:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:24:25.164-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:24:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:24:55.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:24:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:25:25.580-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:25:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:25:55.920-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:25:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:26:26.188-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:26:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:26:56.529-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:26:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:27:26.906-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:27:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:27:57.054-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:27:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:28:27.203-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:28:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:28:32.148-0500 [conn1350] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T03:28:57.340-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:28:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:29:27.622-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:29:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:29:57.961-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:29:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:30:28.237-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:30:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:30:58.387-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:30:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:31:28.595-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:31:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:31:58.880-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:31:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:32:29.166-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:32:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:32:59.503-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:32:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:33:29.779-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:33:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:33:32.223-0500 [conn1351] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T03:34:00.053-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:33:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:34:30.338-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:34:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:35:00.611-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:35:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:35:30.895-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:35:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:36:01.195-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:36:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:36:31.494-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:36:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:37:01.767-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:37:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:37:32.115-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:37:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:38:02.413-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:38:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:38:32.249-0500 [conn1352] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T03:38:32.675-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:38:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:39:02.918-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:39:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:39:33.100-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:39:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:40:03.378-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:40:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:40:33.651-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:40:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:41:03.946-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:41:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:41:34.172-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:41:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:42:04.312-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:42:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:42:34.583-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:42:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:43:04.750-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:43:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:43:32.282-0500 [conn1353] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T03:43:35.027-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:43:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:44:05.270-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:44:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:44:35.413-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:44:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:45:05.607-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:45:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:45:35.800-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:45:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:46:06.122-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:46:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:46:36.515-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:46:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:47:06.773-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:47:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:47:37.050-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:47:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:48:07.336-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:48:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:48:32.289-0500 [conn1354] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T03:48:37.472-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:48:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:49:07.782-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:49:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:49:38.047-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:49:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:50:08.333-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:50:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:50:38.591-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:50:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:51:08.889-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:51:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:51:39.064-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:51:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:52:09.308-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:52:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:52:39.609-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:52:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:53:09.768-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:53:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:53:32.221-0500 [conn1355] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T03:53:40.063-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:53:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:54:10.362-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:54:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:54:40.675-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:54:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:55:10.887-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:55:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:55:41.137-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:55:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:56:11.410-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:56:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:56:41.897-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:56:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:57:12.202-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:57:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:57:42.451-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:57:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:58:12.735-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:58:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:58:32.320-0500 [conn1356] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T03:58:43.003-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:58:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:59:13.820-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:59:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T03:59:44.137-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 03:59:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:00:14.321-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:00:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:00:44.694-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:00:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:01:14.997-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:01:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:01:45.277-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:01:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:02:15.573-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:02:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:02:45.837-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:02:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:03:16.235-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:03:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:03:32.368-0500 [conn1357] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T04:03:46.510-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:03:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:04:16.727-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:04:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:04:46.979-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:04:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:05:17.333-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:05:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:05:47.619-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:05:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:06:17.905-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:06:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:06:48.185-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:06:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:07:18.457-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:07:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:07:48.700-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:07:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:08:18.963-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:08:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:08:32.150-0500 [conn1358] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T04:08:49.300-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:08:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:09:19.453-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:09:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:09:49.733-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:09:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:10:20.203-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:10:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:10:50.485-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:10:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:11:20.753-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:11:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:11:51.030-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:11:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:12:21.222-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:12:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:12:51.410-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:12:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:13:21.567-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:13:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:13:32.176-0500 [conn1359] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T04:13:51.860-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:13:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:14:22.107-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:14:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:14:52.392-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:14:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:15:22.651-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:15:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:15:52.968-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:15:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:16:23.262-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:16:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:16:53.549-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:16:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:17:23.818-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:17:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:17:54.052-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:17:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:18:24.342-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:18:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:18:32.242-0500 [conn1360] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T04:18:54.538-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:18:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:19:24.803-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:19:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:19:55.212-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:19:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:20:25.496-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:20:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:20:55.766-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:20:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:21:25.989-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:21:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:21:56.185-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:21:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:22:26.446-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:22:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:22:56.842-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:22:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:23:27.113-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:23:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:23:32.186-0500 [conn1361] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T04:23:57.410-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:23:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:24:27.682-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:24:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:24:58.084-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:24:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:25:28.458-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:25:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:25:58.659-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:25:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:26:29.010-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:26:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:26:59.339-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:26:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:27:29.626-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:27:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:27:59.927-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:27:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:28:30.332-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:28:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:28:32.266-0500 [conn1362] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T04:29:00.751-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:29:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:29:31.028-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:29:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:30:01.414-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:30:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:30:20.129-0500 [conn1363] authenticate db: historyDb { authenticate: 1, user: "its_rw", nonce: "xxx", key: "xxx" } 2017-01-27T04:30:31.618-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:30:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:31:01.865-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:31:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:31:32.145-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:31:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:32:02.440-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:32:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:32:32.714-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:32:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:33:02.927-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:33:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:33:32.325-0500 [conn1364] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T04:33:33.225-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:33:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:34:03.530-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:34:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:34:33.787-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:34:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:35:04.057-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:35:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:35:34.283-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:35:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:36:04.506-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:36:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:36:34.792-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:36:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:37:05.096-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:37:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:37:35.360-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:37:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:38:05.576-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:38:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:38:32.204-0500 [conn1365] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T04:38:35.945-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:38:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:39:06.168-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:39:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:39:36.318-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:39:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:40:06.616-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:40:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:40:36.914-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:40:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:41:07.204-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:41:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:41:37.417-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:41:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:42:07.703-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:42:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:42:38.139-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:42:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:43:08.425-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:43:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:43:32.312-0500 [conn1366] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T04:43:38.723-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:43:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:44:09.011-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:44:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:44:39.279-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:44:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:45:09.585-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:45:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:45:39.925-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:45:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:46:10.102-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:46:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:46:40.409-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:46:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:47:10.750-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:47:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:47:41.015-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:47:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:48:11.296-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:48:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:48:32.179-0500 [conn1367] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T04:48:41.594-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:48:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:49:11.931-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:49:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:49:42.130-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:49:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:50:12.318-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:50:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:50:42.725-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:50:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:51:13.028-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:51:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:51:43.357-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:51:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:52:13.557-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:52:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:52:43.858-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:52:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:53:14.038-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:53:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:53:32.113-0500 [conn1368] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T04:53:44.270-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:53:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:54:14.552-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:54:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:54:44.964-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:54:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:55:15.364-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:55:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:55:45.643-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:55:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:56:15.999-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:56:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:56:46.263-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:56:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:57:16.555-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:57:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:57:46.954-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:57:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:58:17.326-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:58:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:58:32.201-0500 [conn1369] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T04:58:47.587-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:58:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:59:17.886-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:59:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T04:59:48.176-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 04:59:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:00:18.330-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:00:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:00:48.605-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:00:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:01:18.926-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:01:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:01:49.203-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:01:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:02:19.470-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:02:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:02:49.687-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:02:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:03:19.901-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:03:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:03:32.225-0500 [conn1370] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T05:03:50.175-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:03:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:04:20.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:04:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:04:50.706-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:04:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:05:20.922-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:05:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:05:51.197-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:05:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:06:21.447-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:06:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:06:51.713-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:06:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:07:22.098-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:07:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:07:52.381-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:07:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:08:22.656-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:08:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:08:32.230-0500 [conn1371] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T05:08:52.944-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:08:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:09:23.094-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:09:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:09:53.253-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:09:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:10:23.530-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:10:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:10:53.906-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:10:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:11:24.103-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:11:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:11:54.474-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:11:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:12:24.754-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:12:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:12:55.017-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:12:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:13:25.188-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:13:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:13:32.195-0500 [conn1372] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T05:13:55.473-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:13:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:14:25.613-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:14:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:14:55.896-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:14:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:15:26.174-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:15:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:15:56.466-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:15:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:16:26.654-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:16:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:16:56.930-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:16:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:17:27.099-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:17:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:17:57.382-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:17:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:18:27.637-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:18:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:18:32.213-0500 [conn1373] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T05:18:57.787-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:18:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:19:28.072-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:19:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:19:58.322-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:19:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:20:28.621-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:20:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:20:58.925-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:20:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:21:29.244-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:21:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:21:59.517-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:21:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:22:29.773-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:22:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:23:00.092-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:22:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:23:30.372-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:23:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:23:32.164-0500 [conn1374] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T05:24:00.655-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:24:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:24:30.842-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:24:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:25:01.065-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:25:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:25:31.305-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:25:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:26:01.679-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:26:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:26:31.937-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:26:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:27:02.223-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:27:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:27:32.515-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:27:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:28:02.813-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:28:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:28:32.451-0500 [conn1375] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T05:28:33.103-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:28:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:29:03.453-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:29:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:29:33.723-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:29:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:30:03.999-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:30:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:30:34.275-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:30:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:31:04.649-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:31:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:31:34.933-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:31:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:32:05.266-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:32:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:32:35.546-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:32:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:33:05.825-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:33:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:33:32.241-0500 [conn1376] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T05:33:36.102-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:33:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:34:06.375-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:34:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:34:36.697-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:34:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:35:06.905-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:35:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:35:37.176-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:35:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:36:07.319-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:36:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:36:37.673-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:36:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:37:08.044-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:37:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:37:38.332-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:37:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:38:08.503-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:38:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:38:32.304-0500 [conn1377] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T05:38:38.801-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:38:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:39:09.085-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:39:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:39:39.349-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:39:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:40:09.647-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:40:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:40:39.923-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:40:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:41:10.183-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:41:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:41:40.475-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:41:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:42:10.740-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:42:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:42:41.019-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:42:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:43:11.287-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:43:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:43:32.322-0500 [conn1378] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T05:43:41.577-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:43:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:44:11.811-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:44:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:44:42.075-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:44:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:45:12.356-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:45:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:45:42.709-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:45:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:46:13.004-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:46:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:46:43.282-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:46:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:47:13.749-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:47:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:47:44.036-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:47:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:48:14.175-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:48:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:48:32.263-0500 [conn1379] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T05:48:44.315-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:48:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:49:14.609-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:49:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:49:44.869-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:49:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:50:15.067-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:50:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:50:45.214-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:50:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:51:15.510-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:51:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:51:45.855-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:51:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:52:16.132-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:52:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:52:46.312-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:52:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:53:16.628-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:53:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:53:32.233-0500 [conn1380] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T05:53:46.824-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:53:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:54:17.149-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:54:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:54:47.422-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:54:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:55:17.590-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:55:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:55:47.969-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:55:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:56:18.269-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:56:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:56:48.555-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:56:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:57:18.908-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:57:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:57:49.185-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:57:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:58:19.572-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:58:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:58:32.333-0500 [conn1381] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T05:58:49.845-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:58:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:59:20.130-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:59:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T05:59:50.407-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 05:59:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:00:20.584-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:00:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:00:50.852-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:00:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:01:21.050-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:01:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:01:51.365-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:01:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:02:21.674-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:02:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:02:51.895-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:02:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:03:22.081-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:03:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:03:32.305-0500 [conn1382] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T06:03:52.351-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:03:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:04:22.621-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:04:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:04:52.899-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:04:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:05:23.119-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:05:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:05:53.328-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:05:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:06:23.590-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:06:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:06:53.855-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:06:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:07:24.070-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:07:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:07:54.317-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:07:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:08:24.640-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:08:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:08:32.179-0500 [conn1383] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T06:08:55.146-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:08:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:09:25.485-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:09:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:09:56.022-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:09:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:10:26.267-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:10:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:10:56.526-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:10:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:11:26.731-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:11:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:11:56.993-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:11:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:12:27.274-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:12:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:12:57.420-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:12:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:13:27.787-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:13:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:13:32.114-0500 [conn1384] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T06:13:58.061-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:13:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:14:28.387-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:14:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:14:58.584-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:14:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:15:28.910-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:15:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:15:59.254-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:15:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:16:29.606-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:16:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:16:59.913-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:16:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:17:30.192-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:17:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:18:00.351-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:18:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:18:30.699-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:18:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:18:32.173-0500 [conn1385] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T06:19:01.068-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:19:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:19:31.371-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:19:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:20:01.659-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:20:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:20:31.941-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:20:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:21:02.220-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:21:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:21:32.609-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:21:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:22:02.920-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:22:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:22:33.069-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:22:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:23:03.456-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:23:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:23:32.203-0500 [conn1386] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T06:23:33.727-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:23:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:24:04.009-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:24:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:24:34.376-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:24:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:25:04.687-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:25:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:25:34.970-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:25:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:26:05.263-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:26:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:26:35.543-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:26:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:27:05.828-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:27:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:27:36.028-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:27:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:28:06.298-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:28:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:28:32.256-0500 [conn1387] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T06:28:36.440-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:28:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:29:06.625-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:29:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:29:36.899-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:29:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:30:07.173-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:30:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:30:37.554-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:30:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:31:07.836-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:31:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:31:38.124-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:31:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:32:08.577-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:32:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:32:38.850-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:32:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:33:09.119-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:33:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:33:32.314-0500 [conn1388] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T06:33:39.274-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:33:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:34:09.581-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:34:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:34:39.754-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:34:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:35:10.014-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:35:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:35:40.286-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:35:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:36:10.481-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:36:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:36:40.755-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:36:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:37:11.118-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:37:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:37:41.337-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:37:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:38:11.617-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:38:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:38:32.169-0500 [conn1389] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T06:38:41.932-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:38:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:39:12.210-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:39:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:39:42.477-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:39:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:40:12.746-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:40:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:40:43.044-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:40:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:41:13.224-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:41:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:41:43.560-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:41:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:42:13.940-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:42:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:42:44.137-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:42:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:43:14.411-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:43:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:43:32.267-0500 [conn1390] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T06:43:44.701-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:43:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:44:15.000-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:44:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:44:45.294-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:44:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:45:15.584-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:45:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:45:45.838-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:45:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:46:16.113-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:46:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:46:46.524-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:46:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:47:16.892-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:47:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:47:47.146-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:47:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:48:17.300-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:48:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:48:32.193-0500 [conn1391] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T06:48:47.457-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:48:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:49:17.724-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:49:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:49:47.989-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:49:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:50:18.290-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:50:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:50:48.550-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:50:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:51:18.839-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:51:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:51:49.021-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:51:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:52:19.192-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:52:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:52:49.496-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:52:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:53:19.817-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:53:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:53:32.100-0500 [conn1392] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T06:53:50.106-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:53:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:54:20.380-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:54:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:54:50.559-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:54:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:55:20.841-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:55:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:55:51.052-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:55:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:56:21.340-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:56:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:56:51.612-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:56:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:57:21.779-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:57:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:57:52.043-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:57:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:58:22.417-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:58:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:58:32.152-0500 [conn1393] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T06:58:52.680-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:58:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:59:22.937-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:59:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T06:59:53.247-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 06:59:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:00:23.535-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:00:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:00:53.825-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:00:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:01:23.962-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:01:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:01:54.204-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:01:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:02:24.482-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:02:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:02:54.661-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:02:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:03:25.047-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:03:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:03:32.267-0500 [conn1394] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T07:03:55.317-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:03:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:04:25.537-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:04:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:04:55.837-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:04:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:05:26.284-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:05:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:05:56.495-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:05:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:06:26.802-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:06:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:06:57.082-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:06:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:07:27.498-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:07:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:07:57.763-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:07:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:08:28.035-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:08:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:08:32.245-0500 [conn1395] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T07:08:58.397-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:08:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:09:28.654-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:09:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:09:58.887-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:09:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:10:29.176-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:10:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:10:59.466-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:10:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:11:29.740-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:11:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:12:00.078-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:11:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:12:30.376-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:12:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:13:00.649-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:13:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:13:30.972-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:13:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:13:32.329-0500 [conn1396] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T07:14:01.322-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:14:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:14:31.602-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:14:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:15:02.047-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:15:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:15:32.323-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:15:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:16:02.609-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:16:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:16:33.019-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:16:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:17:03.251-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:17:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:17:33.500-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:17:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:18:03.775-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:18:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:18:32.242-0500 [conn1397] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T07:18:34.030-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:18:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:19:04.306-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:19:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:19:34.593-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:19:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:20:05.014-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:20:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:20:35.433-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:20:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:21:05.719-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:21:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:21:36.007-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:21:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:22:06.278-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:22:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:22:36.524-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:22:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:23:06.805-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:23:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:23:32.193-0500 [conn1398] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T07:23:37.001-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:23:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:24:07.281-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:24:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:24:37.542-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:24:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:25:07.858-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:25:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:25:38.135-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:25:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:26:08.457-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:26:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:26:38.714-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:26:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:27:09.006-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:27:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:27:39.188-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:27:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:28:09.352-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:28:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:28:32.187-0500 [conn1399] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T07:28:39.669-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:28:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:29:09.948-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:29:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:29:40.083-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:29:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:30:10.371-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:30:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:30:40.561-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:30:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:31:10.709-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:31:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:31:40.906-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:31:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:32:11.182-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:32:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:32:41.480-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:32:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:33:11.806-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:33:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:33:32.192-0500 [conn1400] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T07:33:41.945-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:33:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:34:12.221-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:34:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:34:42.393-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:34:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:35:12.594-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:35:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:35:42.863-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:35:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:36:13.147-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:36:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:36:43.431-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:36:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:37:13.708-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:37:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:37:44.001-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:37:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:38:14.326-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:38:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:38:32.269-0500 [conn1401] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T07:38:44.503-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:38:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:39:14.769-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:39:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:39:45.050-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:39:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:40:15.346-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:40:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:40:45.637-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:40:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:41:15.926-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:41:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:41:46.191-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:41:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:42:16.481-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:42:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:42:46.860-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:42:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:43:17.005-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:43:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:43:32.253-0500 [conn1402] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T07:43:47.366-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:43:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:44:17.585-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:44:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:44:47.902-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:44:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:45:18.194-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:45:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:45:48.475-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:45:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:46:18.752-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:46:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:46:49.026-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:46:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:47:19.306-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:47:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:47:49.597-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:47:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:48:19.888-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:48:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:48:32.173-0500 [conn1403] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T07:48:50.177-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:48:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:49:20.426-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:49:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:49:50.721-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:49:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:50:21.020-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:50:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:50:51.324-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:50:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:51:21.666-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:51:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:51:51.833-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:51:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:52:22.104-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:52:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:52:52.383-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:52:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:53:22.654-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:53:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:53:32.159-0500 [conn1404] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T07:53:52.869-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:53:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:54:23.076-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:54:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:54:53.307-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:54:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:55:23.533-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:55:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:55:53.748-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:55:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:56:24.035-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:56:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:56:54.328-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:56:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:57:24.636-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:57:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:57:54.938-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:57:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:58:25.221-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:58:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:58:32.181-0500 [conn1405] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T07:58:55.498-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:58:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:59:25.785-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:59:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T07:59:56.053-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 07:59:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:00:26.352-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:00:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:00:56.691-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:00:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:01:26.958-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:01:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:01:57.239-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:01:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:02:27.526-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:02:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:02:57.783-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:02:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:03:27.952-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:03:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:03:32.106-0500 [conn1406] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T08:03:58.247-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:03:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:04:28.409-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:04:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:04:58.717-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:04:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:05:29.015-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:05:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:05:59.301-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:05:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:06:29.522-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:06:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:06:59.693-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:06:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:07:29.904-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:07:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:08:00.105-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:07:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:08:30.426-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:08:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:08:32.294-0500 [conn1407] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T08:09:00.578-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:09:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:09:30.912-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:09:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:10:01.338-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:10:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:10:31.698-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:10:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:11:01.895-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:11:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:11:32.267-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:11:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:12:02.555-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:12:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:12:32.898-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:12:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:13:03.106-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:13:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:13:32.211-0500 [conn1408] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T08:13:33.448-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:13:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:14:03.611-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:14:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:14:34.081-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:14:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:15:04.246-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:15:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:15:34.518-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:15:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:16:04.924-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:16:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:16:35.219-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:16:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:17:05.499-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:17:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:17:35.717-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:17:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:18:06.168-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:18:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:18:32.247-0500 [conn1409] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T08:18:36.442-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:18:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:19:06.622-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:19:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:19:36.976-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:19:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:20:07.236-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:20:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:20:37.542-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:20:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:21:07.952-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:21:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:21:38.221-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:21:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:22:08.510-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:22:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:22:38.680-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:22:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:23:08.964-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:23:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:23:32.146-0500 [conn1410] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T08:23:39.168-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:23:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:24:09.458-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:24:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:24:39.775-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:24:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:25:10.057-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:25:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:25:40.322-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:25:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:26:10.615-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:26:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:26:40.999-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:26:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:27:11.395-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:27:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:27:41.603-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:27:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:28:11.949-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:28:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:28:32.244-0500 [conn1411] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T08:28:42.237-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:28:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:29:12.499-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:29:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:29:42.811-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:29:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:30:13.093-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:30:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:30:43.359-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:30:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:31:13.606-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:31:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:31:43.968-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:31:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:32:14.134-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:32:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:32:44.393-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:32:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:33:14.671-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:33:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:33:32.135-0500 [conn1412] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T08:33:44.897-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:33:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:34:15.170-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:34:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:34:45.316-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:34:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:35:15.644-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:35:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:35:45.926-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:35:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:36:16.216-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:36:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:36:46.487-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:36:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:37:16.753-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:37:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:37:47.209-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:37:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:38:17.483-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:38:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:38:32.243-0500 [conn1413] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T08:38:47.833-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:38:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:39:18.110-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:39:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:39:48.407-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:39:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:40:18.646-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:40:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:40:48.885-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:40:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:41:19.155-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:41:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:41:49.445-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:41:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:42:19.664-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:42:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:42:49.934-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:42:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:43:20.173-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:43:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:43:32.104-0500 [conn1414] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T08:43:50.486-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:43:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:44:20.765-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:44:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:44:50.967-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:44:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:45:21.131-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:45:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:45:51.375-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:45:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:46:21.647-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:46:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:46:51.932-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:46:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:47:22.339-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:47:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:47:52.605-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:47:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:48:22.961-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:48:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:48:32.240-0500 [conn1415] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T08:48:53.220-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:48:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:49:23.544-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:49:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:49:53.823-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:49:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:50:24.102-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:50:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:50:54.296-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:50:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:51:24.613-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:51:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:51:54.915-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:51:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:52:25.174-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:52:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:52:55.452-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:52:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:53:25.736-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:53:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:53:32.097-0500 [conn1416] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T08:53:56.003-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:53:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:54:26.142-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:54:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:54:56.478-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:54:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:55:26.839-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:55:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:55:57.121-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:55:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:56:27.319-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:56:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:56:57.578-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:56:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:57:27.894-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:57:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:57:58.198-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:57:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:58:28.433-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:58:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:58:32.144-0500 [conn1417] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T08:58:58.798-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:58:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:59:28.977-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:59:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T08:59:59.236-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 08:59:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:00:29.397-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:00:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:00:59.665-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:00:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:01:30.094-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:01:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:02:00.461-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:02:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:02:30.674-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:02:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:03:00.842-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:03:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:03:31.184-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:03:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:03:32.341-0500 [conn1418] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T09:04:01.508-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:04:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:04:31.754-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:04:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:05:02.037-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:05:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:05:32.283-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:05:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:06:02.526-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:06:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:06:32.879-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:06:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:07:03.142-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:07:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:07:33.411-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:07:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:08:03.660-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:08:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:08:32.101-0500 [conn1419] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T09:08:33.971-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:08:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:09:04.212-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:09:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:09:34.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:09:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:10:04.915-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:10:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:10:35.224-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:10:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:11:05.410-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:11:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:11:35.747-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:11:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:12:05.984-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:12:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:12:36.212-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:12:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:13:06.530-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:13:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:13:32.145-0500 [conn1420] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T09:13:36.793-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:13:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:14:07.035-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:14:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:14:37.325-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:14:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:15:07.715-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:15:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:15:38.114-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:15:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:16:08.376-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:16:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:16:38.640-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:16:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:17:08.946-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:17:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:17:39.192-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:17:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:18:09.439-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:18:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:18:32.191-0500 [conn1421] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T09:18:39.799-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:18:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:19:10.142-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:19:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:19:40.409-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:19:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:20:10.691-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:20:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:20:40.948-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:20:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:21:11.130-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:21:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:21:41.439-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:21:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:22:11.754-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:22:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:22:42.013-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:22:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:23:12.385-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:23:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:23:32.315-0500 [conn1422] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T09:23:42.653-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:23:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:24:12.839-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:24:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:24:43.132-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:24:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:25:13.361-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:25:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:25:43.713-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:25:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:26:13.941-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:26:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:26:44.182-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:26:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:27:14.486-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:27:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:27:44.790-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:27:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:28:15.102-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:28:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:28:32.329-0500 [conn1423] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T09:28:45.336-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:28:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:29:15.613-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:29:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:29:45.800-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:29:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:30:16.086-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:30:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:30:46.376-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:30:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:31:16.671-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:31:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:31:46.918-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:31:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:32:17.208-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:32:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:32:47.496-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:32:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:33:17.783-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:33:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:33:32.097-0500 [conn1424] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T09:33:48.036-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:33:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:34:18.263-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:34:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:34:48.464-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:34:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:35:18.804-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:35:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:35:49.029-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:35:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:36:19.352-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:36:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:36:49.693-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:36:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:37:19.843-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:37:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:37:50.112-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:37:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:38:20.352-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:38:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:38:32.252-0500 [conn1425] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T09:38:50.776-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:38:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:39:21.163-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:39:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:39:51.417-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:39:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:40:21.695-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:40:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:40:51.936-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:40:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:41:22.196-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:41:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:41:52.513-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:41:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:42:22.771-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:42:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:42:53.064-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:42:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:43:23.462-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:43:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:43:32.208-0500 [conn1426] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T09:43:53.777-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:43:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:44:24.059-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:44:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:44:54.349-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:44:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:45:24.599-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:45:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:45:54.972-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:45:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:46:25.259-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:46:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:46:55.561-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:46:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:47:25.829-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:47:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:47:56.060-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:47:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:48:26.456-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:48:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:48:32.082-0500 [conn1427] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T09:48:56.704-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:48:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:49:26.984-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:49:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:49:57.253-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:49:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:50:27.656-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:50:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:50:57.923-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:50:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:51:28.222-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:51:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:51:58.535-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:51:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:52:28.784-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:52:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:52:59.105-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:52:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:53:29.418-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:53:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:53:32.302-0500 [conn1428] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T09:53:59.638-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:53:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:54:29.976-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:54:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:55:00.195-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:54:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:55:30.559-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:55:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:56:00.797-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:56:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:56:31.150-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:56:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:57:01.518-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:57:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:57:31.872-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:57:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:58:02.318-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:58:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:58:32.128-0500 [conn1429] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T09:58:32.559-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:58:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:59:02.773-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:59:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T09:59:32.992-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 09:59:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:00:03.864-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:00:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:00:34.124-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:00:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:01:04.451-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:01:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:01:34.709-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:01:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:02:05.005-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:02:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:02:35.268-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:02:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:03:05.583-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:03:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:03:32.201-0500 [conn1430] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T10:03:35.809-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:03:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:04:06.020-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:04:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:04:36.215-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:04:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:05:06.607-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:05:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:05:36.837-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:05:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:06:07.138-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:06:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:06:37.446-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:06:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:07:07.762-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:07:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:07:38.037-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:07:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:08:08.268-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:08:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:08:32.102-0500 [conn1431] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T10:08:38.535-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:08:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:09:08.895-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:09:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:09:39.233-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:09:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:10:09.501-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:10:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:10:39.819-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:10:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:11:10.058-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:11:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:11:40.349-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:11:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:12:10.778-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:12:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:12:41.080-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:12:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:13:11.612-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:13:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:13:32.256-0500 [conn1432] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T10:13:41.808-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:13:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:14:12.163-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:14:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:14:42.436-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:14:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:15:12.622-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:15:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:15:42.961-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:15:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:16:13.211-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:16:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:16:43.410-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:16:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:17:13.716-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:17:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:17:44.056-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:17:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:18:14.289-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:18:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:18:32.299-0500 [conn1433] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T10:18:44.578-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:18:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:19:14.867-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:19:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:19:45.296-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:19:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:20:15.563-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:20:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:20:45.708-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:20:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:21:16.022-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:21:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:21:46.338-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:21:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:22:16.616-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:22:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:22:46.831-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:22:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:23:17.103-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:23:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:23:32.180-0500 [conn1434] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T10:23:47.385-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:23:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:24:17.611-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:24:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:24:47.876-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:24:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:25:18.093-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:25:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:25:48.525-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:25:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:26:18.822-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:26:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:26:49.193-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:26:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:27:19.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:27:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:27:49.770-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:27:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:28:20.081-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:28:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:28:32.323-0500 [conn1435] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T10:28:50.371-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:28:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:29:20.754-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:29:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:29:51.057-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:29:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:30:21.315-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:30:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:30:51.651-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:30:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:31:21.948-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:31:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:31:52.222-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:31:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:32:22.458-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:32:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:32:52.889-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:32:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:33:23.227-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:33:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:33:32.161-0500 [conn1436] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T10:33:53.446-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:33:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:34:23.606-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:34:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:34:53.960-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:34:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:35:24.358-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:35:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:35:54.627-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:35:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:36:24.876-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:36:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:36:55.307-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:36:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:37:25.662-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:37:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:37:55.932-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:37:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:38:26.314-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:38:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:38:32.166-0500 [conn1437] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T10:38:56.675-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:38:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:39:27.072-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:39:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:39:57.341-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:39:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:40:27.586-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:40:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:40:57.995-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:40:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:41:28.330-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:41:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:41:58.656-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:41:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:42:28.934-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:42:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:42:59.204-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:42:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:43:29.475-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:43:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:43:32.197-0500 [conn1438] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T10:43:59.799-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:43:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:44:30.048-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:44:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:45:00.298-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:45:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:45:30.514-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:45:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:46:00.713-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:46:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:46:30.998-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:46:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:47:01.333-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:47:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:47:31.628-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:47:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:48:01.918-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:48:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:48:32.250-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:48:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:48:32.283-0500 [conn1439] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T10:49:02.517-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:49:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:49:32.705-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:49:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:50:02.977-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:50:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:50:33.303-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:50:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:51:03.580-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:51:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:51:33.742-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:51:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:52:03.940-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:52:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:52:34.217-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:52:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:53:04.419-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:53:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:53:32.204-0500 [conn1440] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T10:53:34.806-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:53:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:54:05.065-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:54:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:54:35.336-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:54:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:55:05.503-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:55:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:55:35.863-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:55:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:56:06.136-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:56:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:56:36.378-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:56:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:57:06.657-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:57:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:57:36.937-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:57:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:58:07.200-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:58:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:58:32.204-0500 [conn1441] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T10:58:37.493-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:58:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:59:07.681-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:59:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T10:59:38.031-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 10:59:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:00:08.259-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:00:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:00:38.551-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:00:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:01:08.831-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:01:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:01:39.152-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:01:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:02:09.426-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:02:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:02:39.679-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:02:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:03:09.939-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:03:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:03:32.336-0500 [conn1442] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T11:03:40.249-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:03:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:04:10.523-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:04:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:04:40.772-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:04:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:05:11.121-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:05:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:05:41.299-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:05:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:06:11.529-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:06:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:06:41.894-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:06:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:07:12.238-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:07:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:07:42.735-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:07:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:08:12.901-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:08:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:08:32.173-0500 [conn1443] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T11:08:43.192-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:08:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:09:13.464-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:09:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:09:43.745-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:09:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:10:14.051-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:10:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:10:44.195-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:10:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:11:14.381-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:11:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:11:44.682-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:11:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:12:14.957-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:12:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:12:45.262-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:12:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:13:15.538-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:13:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:13:32.257-0500 [conn1444] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T11:13:45.806-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:13:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:14:16.228-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:14:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:14:46.580-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:14:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:15:16.748-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:15:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:15:47.038-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:15:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:16:17.296-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:16:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:16:47.555-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:16:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:17:17.808-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:17:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:17:47.959-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:17:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:18:18.212-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:18:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:18:32.283-0500 [conn1445] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T11:18:48.361-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:18:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:19:18.691-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:19:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:19:49.015-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:19:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:20:19.368-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:20:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:20:49.621-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:20:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:21:19.793-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:21:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:21:50.075-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:21:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:22:20.349-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:22:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:22:50.605-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:22:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:23:20.902-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:23:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:23:32.295-0500 [conn1446] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T11:23:51.317-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:23:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:24:21.590-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:24:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:24:51.734-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:24:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:25:22.008-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:25:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:25:52.294-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:25:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:26:22.605-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:26:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:26:52.870-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:26:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:27:23.074-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:27:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:27:53.287-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:27:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:28:23.608-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:28:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:28:32.316-0500 [conn1447] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T11:28:53.907-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:28:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:29:24.189-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:29:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:29:54.366-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:29:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:30:24.634-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:30:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:30:54.899-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:30:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:31:25.183-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:31:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:31:55.575-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:31:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:32:25.928-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:32:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:32:56.211-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:32:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:33:26.452-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:33:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:33:32.141-0500 [conn1448] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T11:33:56.672-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:33:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:34:27.070-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:34:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:34:57.207-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:34:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:35:27.459-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:35:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:35:57.743-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:35:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:36:28.072-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:36:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:36:58.338-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:36:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:37:28.523-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:37:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:37:58.813-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:37:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:38:29.020-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:38:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:38:32.124-0500 [conn1449] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T11:38:59.304-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:38:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:39:29.686-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:39:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:39:59.869-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:39:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:40:30.156-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:40:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:41:00.408-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:41:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:41:30.694-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:41:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:42:00.926-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:42:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:42:31.267-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:42:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:43:01.456-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:43:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:43:31.740-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:43:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:43:32.295-0500 [conn1450] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T11:44:01.895-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:44:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:44:32.125-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:44:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:45:02.454-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:45:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:45:32.719-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:45:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:46:02.998-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:46:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:46:33.363-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:46:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:47:03.730-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:47:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:47:34.093-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:47:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:48:04.357-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:48:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:48:32.205-0500 [conn1451] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T11:48:34.597-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:48:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:49:04.973-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:49:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:49:35.239-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:49:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:50:05.483-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:50:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:50:35.661-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:50:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:51:06.129-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:51:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:51:36.338-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:51:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:52:06.533-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:52:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:52:36.796-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:52:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:53:06.979-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:53:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:53:32.302-0500 [conn1452] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T11:53:37.280-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:53:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:54:07.549-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:54:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:54:37.732-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:54:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:55:08.075-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:55:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:55:38.335-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:55:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:56:08.529-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:56:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:56:38.806-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:56:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:57:08.948-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:57:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:57:39.250-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:57:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:58:09.546-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:58:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:58:32.173-0500 [conn1453] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T11:58:39.833-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:58:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:59:10.111-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:59:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T11:59:40.398-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 11:59:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:00:10.712-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:00:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:00:40.983-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:00:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:01:11.616-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:01:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:01:41.962-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:01:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:02:12.232-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:02:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:02:42.501-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:02:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:03:12.770-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:03:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:03:32.347-0500 [conn1454] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T12:03:43.060-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:03:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:04:13.343-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:04:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:04:43.627-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:04:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:05:13.916-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:05:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:05:44.359-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:05:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:06:14.645-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:06:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:06:44.958-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:06:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:07:15.212-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:07:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:07:45.546-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:07:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:08:15.812-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:08:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:08:32.271-0500 [conn1455] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T12:08:46.176-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:08:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:09:16.435-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:09:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:09:46.750-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:09:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:10:17.018-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:10:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:10:47.393-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:10:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:11:17.682-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:11:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:11:48.024-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:11:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:12:18.399-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:12:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:12:48.604-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:12:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:13:18.789-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:13:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:13:32.151-0500 [conn1456] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T12:13:48.967-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:13:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:14:19.262-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:14:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:14:49.507-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:14:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:15:19.791-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:15:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:15:50.025-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:15:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:16:20.311-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:16:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:16:50.619-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:16:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:17:21.035-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:17:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:17:51.405-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:17:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:18:21.567-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:18:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:18:32.325-0500 [conn1457] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T12:18:51.890-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:18:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:19:22.041-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:19:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:19:52.362-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:19:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:20:22.650-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:20:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:20:52.921-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:20:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:21:23.207-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:21:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:21:53.388-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:21:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:22:23.625-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:22:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:22:53.943-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:22:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:23:24.271-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:23:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:23:32.331-0500 [conn1458] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T12:23:54.530-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:23:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:24:24.917-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:24:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:24:55.206-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:24:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:25:25.563-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:25:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:25:55.823-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:25:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:26:26.243-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:26:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:26:56.406-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:26:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:27:26.684-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:27:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:27:56.968-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:27:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:28:27.281-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:28:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:28:32.313-0500 [conn1459] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T12:28:57.512-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:28:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:29:27.786-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:29:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:29:58.044-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:29:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:30:28.326-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:30:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:30:58.601-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:30:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:31:28.874-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:31:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:31:59.181-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:31:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:32:29.463-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:32:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:32:59.791-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:32:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:33:30.194-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:33:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:33:32.110-0500 [conn1460] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T12:34:00.535-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:34:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:34:30.795-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:34:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:35:01.050-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:35:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:35:31.241-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:35:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:36:01.550-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:36:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:36:31.786-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:36:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:37:02.081-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:37:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:37:32.376-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:37:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:38:02.507-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:38:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:38:32.301-0500 [conn1461] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T12:38:32.793-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:38:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:39:02.935-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:39:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:39:33.113-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:39:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:40:03.339-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:40:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:40:33.584-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:40:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:41:03.900-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:41:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:41:34.294-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:41:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:42:04.573-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:42:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:42:34.842-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:42:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:43:05.024-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:43:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:43:32.211-0500 [conn1462] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T12:43:35.311-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:43:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:44:05.684-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:44:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:44:35.954-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:44:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:45:06.232-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:45:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:45:36.513-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:45:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:46:06.874-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:46:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:46:37.204-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:46:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:47:07.486-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:47:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:47:37.745-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:47:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:48:08.029-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:48:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:48:32.353-0500 [conn1463] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T12:48:38.318-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:48:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:49:08.642-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:49:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:49:38.931-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:49:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:50:09.075-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:50:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:50:39.343-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:50:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:51:09.665-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:51:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:51:40.106-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:51:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:52:10.515-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:52:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:52:40.861-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:52:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:53:11.110-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:53:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:53:32.203-0500 [conn1464] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T12:53:41.386-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:53:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:54:11.544-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:54:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:54:41.850-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:54:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:55:12.224-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:55:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:55:42.424-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:55:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:56:12.795-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:56:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:56:43.094-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:56:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:57:13.376-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:57:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:57:43.749-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:57:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:58:13.991-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:58:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:58:32.318-0500 [conn1465] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T12:58:44.208-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:58:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:59:14.696-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:59:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T12:59:44.925-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 12:59:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:00:15.209-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:00:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:00:45.591-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:00:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:01:15.788-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:01:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:01:46.001-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:01:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:02:16.286-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:02:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:02:46.616-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:02:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:03:16.825-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:03:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:03:32.318-0500 [conn1466] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T13:03:47.116-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:03:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:04:17.347-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:04:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:04:47.722-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:04:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:05:17.961-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:05:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:05:48.253-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:05:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:06:18.460-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:06:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:06:48.672-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:06:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:07:18.915-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:07:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:07:49.259-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:07:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:08:19.537-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:08:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:08:32.167-0500 [conn1467] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T13:08:49.773-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:08:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:09:20.091-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:09:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:09:50.343-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:09:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:10:20.629-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:10:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:10:51.000-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:10:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:11:21.237-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:11:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:11:51.619-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:11:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:12:21.907-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:12:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:12:52.182-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:12:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:13:22.439-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:13:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:13:32.150-0500 [conn1468] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T13:13:52.708-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:13:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:14:23.008-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:14:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:14:53.267-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:14:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:15:23.503-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:15:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:15:53.793-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:15:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:16:24.054-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:16:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:16:54.380-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:16:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:17:24.662-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:17:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:17:54.886-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:17:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:18:25.333-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:18:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:18:32.330-0500 [conn1469] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T13:18:55.778-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:18:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:19:26.113-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:19:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:19:56.278-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:19:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:20:26.561-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:20:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:20:56.874-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:20:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:21:27.101-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:21:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:21:57.329-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:21:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:22:27.627-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:22:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:22:57.962-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:22:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:23:28.167-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:23:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:23:32.264-0500 [conn1470] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T13:23:58.454-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:23:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:24:28.711-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:24:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:24:59.003-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:24:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:25:29.242-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:25:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:25:59.600-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:25:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:26:29.939-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:26:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:27:00.219-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:26:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:27:30.451-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:27:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:28:00.793-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:28:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:28:31.102-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:28:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:28:32.226-0500 [conn1471] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T13:29:01.426-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:29:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:29:31.695-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:29:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:30:01.968-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:30:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:30:32.281-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:30:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:31:02.510-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:31:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:31:32.775-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:31:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:32:03.040-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:32:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:32:33.343-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:32:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:33:03.747-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:33:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:33:32.111-0500 [conn1472] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T13:33:33.984-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:33:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:34:04.354-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:34:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:34:34.517-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:34:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:35:04.786-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:35:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:35:35.083-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:35:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:36:05.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:36:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:36:35.575-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:36:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:37:05.929-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:37:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:37:36.096-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:37:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:38:06.348-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:38:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:38:32.205-0500 [conn1473] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T13:38:36.631-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:38:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:39:06.874-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:39:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:39:37.130-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:39:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:40:07.413-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:40:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:40:37.727-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:40:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:41:08.169-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:41:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:41:38.392-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:41:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:42:08.525-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:42:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:42:38.807-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:42:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:43:09.036-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:43:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:43:32.165-0500 [conn1474] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T13:43:39.386-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:43:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:44:09.683-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:44:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:44:39.920-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:44:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:45:10.260-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:45:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:45:40.534-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:45:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:46:10.802-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:46:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:46:41.081-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:46:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:47:11.351-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:47:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:47:41.693-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:47:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:48:11.968-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:48:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:48:32.313-0500 [conn1475] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T13:48:42.240-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:48:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:49:12.464-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:49:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:49:42.758-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:49:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:50:13.055-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:50:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:50:43.292-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:50:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:51:13.541-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:51:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:51:43.735-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:51:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:52:13.937-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:52:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:52:44.165-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:52:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:53:14.551-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:53:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:53:32.319-0500 [conn1476] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T13:53:44.899-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:53:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:54:15.271-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:54:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:54:45.559-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:54:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:55:15.889-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:55:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:55:46.134-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:55:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:56:16.459-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:56:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:56:46.751-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:56:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:57:17.029-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:57:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:57:47.310-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:57:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:58:17.664-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:58:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:58:32.246-0500 [conn1477] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T13:58:47.993-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:58:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:59:18.496-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:59:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T13:59:48.708-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 13:59:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:00:18.996-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:00:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:00:49.264-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:00:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:01:19.622-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:01:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:01:49.916-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:01:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:02:20.286-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:02:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:02:50.453-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:02:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:03:20.737-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:03:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:03:32.334-0500 [conn1478] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T14:03:51.003-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:03:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:04:21.229-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:04:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:04:51.542-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:04:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:05:21.831-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:05:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:05:52.023-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:05:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:06:22.384-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:06:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:06:52.648-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:06:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:07:22.842-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:07:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:07:53.088-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:07:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:08:23.389-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:08:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:08:32.300-0500 [conn1479] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T14:08:53.816-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:08:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:09:24.116-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:09:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:09:54.271-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:09:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:10:24.546-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:10:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:10:55.010-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:10:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:11:25.312-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:11:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:11:55.560-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:11:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:12:25.798-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:12:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:12:56.121-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:12:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:13:26.514-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:13:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:13:32.346-0500 [conn1480] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T14:13:56.799-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:13:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:14:27.081-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:14:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:14:57.310-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:14:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:15:27.533-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:15:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:15:57.819-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:15:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:16:28.028-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:16:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:16:58.339-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:16:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:17:28.565-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:17:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:17:58.854-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:17:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:18:29.180-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:18:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:18:32.284-0500 [conn1481] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T14:18:59.406-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:18:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:19:29.665-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:19:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:20:00.076-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:19:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:20:30.335-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:20:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:21:00.593-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:21:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:21:30.872-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:21:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:22:01.076-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:22:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:22:31.410-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:22:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:23:01.661-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:23:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:23:32.074-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:23:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:23:32.307-0500 [conn1482] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T14:24:02.388-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:24:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:24:32.620-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:24:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:25:02.902-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:25:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:25:33.166-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:25:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:26:03.433-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:26:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:26:33.600-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:26:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:26:40.004-0500 [conn1486] authenticate db: historyDb { authenticate: 1, user: "its_rw", nonce: "xxx", key: "xxx" } 2017-01-27T14:26:40.005-0500 [conn1484] authenticate db: historyDb { authenticate: 1, user: "its_rw", nonce: "xxx", key: "xxx" } 2017-01-27T14:26:40.005-0500 [conn1485] authenticate db: historyDb { authenticate: 1, user: "its_rw", nonce: "xxx", key: "xxx" } 2017-01-27T14:26:40.005-0500 [conn1483] authenticate db: historyDb { authenticate: 1, user: "its_rw", nonce: "xxx", key: "xxx" } 2017-01-27T14:27:03.901-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:27:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:27:34.249-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:27:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:28:04.536-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:28:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:28:32.187-0500 [conn1487] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T14:28:34.886-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:28:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:29:05.196-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:29:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:29:35.449-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:29:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:30:05.740-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:30:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:30:35.985-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:30:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:31:06.269-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:31:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:31:36.530-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:31:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:32:06.776-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:32:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:32:36.995-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:32:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:33:07.392-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:33:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:33:32.329-0500 [conn1488] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T14:33:37.684-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:33:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:34:07.996-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:34:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:34:38.254-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:34:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:35:08.418-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:35:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:35:38.711-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:35:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:36:09.006-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:36:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:36:39.271-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:36:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:37:09.519-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:37:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:37:39.798-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:37:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:38:10.129-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:38:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:38:32.232-0500 [conn1489] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T14:38:40.402-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:38:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:39:10.761-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:39:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:39:41.052-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:39:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:40:11.411-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:40:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:40:41.668-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:40:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:41:12.020-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:41:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:41:42.376-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:41:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:42:12.674-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:42:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:42:42.960-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:42:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:43:13.386-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:43:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:43:32.324-0500 [conn1490] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T14:43:43.616-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:43:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:44:13.840-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:44:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:44:44.115-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:44:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:45:14.322-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:45:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:45:44.607-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:45:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:46:14.793-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:46:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:46:45.083-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:46:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:47:15.353-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:47:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:47:45.575-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:47:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:48:15.936-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:48:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:48:32.213-0500 [conn1491] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T14:48:46.134-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:48:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:49:16.432-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:49:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:49:46.744-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:49:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:50:17.070-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:50:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:50:47.368-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:50:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:51:17.623-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:51:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:51:47.948-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:51:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:52:18.242-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:52:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:52:48.574-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:52:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:53:18.771-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:53:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:53:32.153-0500 [conn1492] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T14:53:49.164-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:53:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:54:19.655-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:54:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:54:49.965-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:54:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:55:20.312-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:55:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:55:50.603-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:55:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:56:20.940-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:56:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:56:51.228-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:56:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:57:21.519-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:57:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:57:51.820-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:57:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:58:22.087-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:58:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:58:32.225-0500 [conn1493] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T14:58:52.260-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:58:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:59:22.676-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:59:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T14:59:52.996-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 14:59:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:00:23.281-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:00:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:00:53.429-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:00:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:01:23.731-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:01:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:01:54.035-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:01:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:02:24.299-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:02:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:02:54.607-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:02:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:03:24.824-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:03:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:03:32.171-0500 [conn1494] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T15:03:55.137-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:03:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:04:25.428-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:04:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:04:55.615-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:04:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:05:25.871-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:05:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:05:56.173-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:05:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:06:26.449-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:06:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:06:56.635-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:06:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:07:26.927-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:07:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:07:57.077-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:07:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:08:27.282-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:08:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:08:32.313-0500 [conn1495] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T15:08:57.643-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:08:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:09:27.941-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:09:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:09:58.147-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:09:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:10:28.314-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:10:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:10:58.591-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:10:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:11:28.827-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:11:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:11:59.110-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:11:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:12:29.420-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:12:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:12:59.722-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:12:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:13:29.943-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:13:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:13:32.221-0500 [conn1496] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T15:14:00.093-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:13:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:14:30.390-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:14:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:15:00.539-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:15:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:15:30.773-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:15:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:16:01.078-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:16:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:16:31.430-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:16:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:17:01.708-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:17:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:17:31.969-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:17:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:18:02.152-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:18:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:18:32.146-0500 [conn1497] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T15:18:32.352-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:18:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:19:02.627-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:19:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:19:32.812-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:19:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:20:03.043-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:20:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:20:33.319-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:20:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:21:03.688-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:21:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:21:33.888-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:21:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:22:04.060-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:22:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:22:34.347-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:22:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:23:04.642-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:23:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:23:32.320-0500 [conn1498] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T15:23:34.978-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:23:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:24:05.219-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:24:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:24:35.500-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:24:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:25:05.687-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:25:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:25:35.985-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:25:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:26:06.281-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:26:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:26:36.578-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:26:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:27:07.006-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:27:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:27:37.326-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:27:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:28:07.633-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:28:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:28:32.270-0500 [conn1499] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T15:28:37.815-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:28:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:29:08.122-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:29:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:29:38.393-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:29:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:30:08.550-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:30:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:30:38.699-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:30:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:31:08.845-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:31:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:31:39.142-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:31:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:32:09.490-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:32:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:32:39.650-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:32:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:33:09.800-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:33:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:33:32.306-0500 [conn1500] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T15:33:40.098-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:33:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:34:10.403-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:34:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:34:40.789-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:34:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:35:11.066-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:35:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:35:41.372-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:35:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:36:11.571-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:36:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:36:41.806-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:36:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:37:11.966-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:37:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:37:42.233-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:37:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:38:12.516-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:38:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:38:32.338-0500 [conn1501] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T15:38:42.685-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:38:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:39:12.941-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:39:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:39:43.247-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:39:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:40:13.500-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:40:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:40:43.770-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:40:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:41:14.152-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:41:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:41:44.460-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:41:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:42:14.748-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:42:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:42:45.030-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:42:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:43:15.181-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:43:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:43:32.334-0500 [conn1502] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T15:43:45.498-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:43:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:44:15.705-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:44:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:44:46.062-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:44:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:45:16.339-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:45:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:45:46.537-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:45:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:46:16.793-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:46:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:46:47.162-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:46:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:47:17.431-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:47:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:47:47.619-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:47:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:48:17.910-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:48:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:48:32.327-0500 [conn1503] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T15:48:48.063-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:48:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:49:18.325-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:49:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:49:48.579-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:49:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:50:18.860-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:50:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:50:49.007-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:50:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:51:19.178-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:51:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:51:49.516-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:51:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:52:19.655-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:52:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:52:49.917-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:52:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:53:20.078-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:53:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:53:32.157-0500 [conn1504] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T15:53:50.354-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:53:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:54:20.617-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:54:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:54:50.875-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:54:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:55:21.052-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:55:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:55:51.353-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:55:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:56:21.621-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:56:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:56:51.926-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:56:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:57:22.067-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:57:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:57:52.324-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:57:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:58:22.653-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:58:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:58:32.238-0500 [conn1505] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T15:58:52.927-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:58:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:59:23.204-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:59:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T15:59:53.380-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 15:59:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:00:23.573-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:00:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:00:53.888-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:00:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:01:24.180-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:01:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:01:54.340-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:01:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:02:24.491-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:02:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:02:54.761-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:02:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:03:24.942-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:03:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:03:32.166-0500 [conn1506] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T16:03:55.154-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:03:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:04:25.429-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:04:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:04:55.695-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:04:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:05:26.089-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:05:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:05:56.423-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:05:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:06:26.659-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:06:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:06:56.958-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:06:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:07:27.238-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:07:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:07:57.614-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:07:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:08:27.854-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:08:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:08:32.199-0500 [conn1507] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T16:08:58.270-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:08:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:09:28.523-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:09:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:09:58.776-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:09:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:10:28.925-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:10:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:10:59.330-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:10:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:11:29.635-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:11:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:11:59.898-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:11:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:12:30.233-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:12:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:13:00.392-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:13:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:13:30.711-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:13:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:13:32.316-0500 [conn1508] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T16:14:00.884-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:14:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:14:31.208-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:14:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:15:01.503-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:15:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:15:31.663-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:15:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:16:01.812-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:16:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:16:31.966-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:16:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:17:02.169-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:17:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:17:32.424-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:17:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:18:02.592-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:18:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:18:32.317-0500 [conn1509] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T16:18:32.869-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:18:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:19:03.159-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:19:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:19:33.537-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:19:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:20:03.825-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:20:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:20:34.224-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:20:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:21:04.500-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:21:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:21:34.760-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:21:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:22:05.049-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:22:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:22:35.305-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:22:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:23:05.589-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:23:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:23:32.149-0500 [conn1510] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T16:23:35.992-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:23:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:24:06.232-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:24:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:24:36.571-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:24:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:25:06.828-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:25:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:25:37.092-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:25:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:26:07.377-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:26:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:26:37.653-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:26:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:27:07.898-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:27:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:27:38.159-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:27:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:28:08.428-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:28:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:28:32.194-0500 [conn1511] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T16:28:38.742-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:28:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:29:08.925-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:29:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:29:39.173-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:29:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:30:09.513-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:30:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:30:39.683-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:30:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:31:09.951-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:31:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:31:40.197-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:31:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:32:10.519-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:32:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:32:40.799-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:32:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:33:11.035-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:33:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:33:32.287-0500 [conn1512] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T16:33:41.578-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:33:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:34:11.931-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:34:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:34:42.258-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:34:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:35:12.451-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:35:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:35:42.891-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:35:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:36:13.090-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:36:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:36:43.520-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:36:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:37:13.721-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:37:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:37:43.985-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:37:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:38:14.280-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:38:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:38:32.214-0500 [conn1513] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T16:38:44.558-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:38:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:39:14.899-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:39:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:39:45.214-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:39:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:40:15.519-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:40:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:40:45.780-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:40:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:41:16.102-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:41:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:41:46.492-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:41:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:42:16.660-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:42:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:42:46.956-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:42:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:43:17.229-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:43:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:43:32.314-0500 [conn1514] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T16:43:47.526-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:43:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:44:17.721-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:44:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:44:47.979-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:44:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:45:18.247-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:45:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:45:48.520-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:45:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:46:18.798-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:46:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:46:48.950-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:46:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:47:19.174-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:47:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:47:49.426-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:47:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:48:19.775-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:48:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:48:32.351-0500 [conn1515] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T16:48:50.097-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:48:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:49:20.510-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:49:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:49:50.850-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:49:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:50:21.122-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:50:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:50:51.249-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:50:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:51:21.618-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:51:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:51:51.871-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:51:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:52:22.187-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:52:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:52:52.357-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:52:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:53:22.568-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:53:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:53:32.180-0500 [conn1516] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T16:53:52.867-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:53:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:54:23.124-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:54:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:54:53.576-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:54:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:55:23.843-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:55:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:55:54.027-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:55:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:56:24.277-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:56:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:56:54.507-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:56:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:57:24.639-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:57:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:57:54.891-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:57:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:58:25.187-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:58:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:58:32.330-0500 [conn1517] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T16:58:55.452-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:58:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:59:25.792-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:59:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T16:59:56.027-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 16:59:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:00:26.238-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:00:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:00:56.531-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:00:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:01:26.801-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:01:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:01:57.000-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:01:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:02:27.145-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:02:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:02:57.329-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:02:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:03:27.758-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:03:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:03:32.101-0500 [conn1518] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T17:03:58.159-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:03:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:04:28.422-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:04:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:04:58.697-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:04:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:05:29.166-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:05:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:05:59.462-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:05:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:06:29.878-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:06:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:07:00.168-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:06:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:07:30.348-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:07:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:08:00.700-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:08:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:08:31.003-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:08:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:08:32.286-0500 [conn1519] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T17:09:01.450-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:09:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:09:31.712-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:09:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:10:01.993-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:10:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:10:32.152-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:10:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:11:02.584-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:11:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:11:32.852-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:11:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:12:03.132-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:12:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:12:33.328-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:12:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:13:03.502-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:13:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:13:32.160-0500 [conn1520] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T17:13:33.803-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:13:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:14:04.075-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:14:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:14:34.433-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:14:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:15:04.557-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:15:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:15:34.689-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:15:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:16:05.045-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:16:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:16:35.333-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:16:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:17:05.592-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:17:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:17:35.869-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:17:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:18:06.126-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:18:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:18:32.127-0500 [conn1521] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T17:18:36.389-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:18:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:19:06.680-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:19:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:19:36.932-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:19:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:20:07.208-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:20:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:20:37.529-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:20:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:21:07.899-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:21:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:21:38.122-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:21:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:22:08.452-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:22:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:22:38.935-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:22:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:23:09.186-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:23:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:23:32.080-0500 [conn1522] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T17:23:39.467-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:23:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:24:09.743-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:24:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:24:40.028-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:24:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:25:10.321-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:25:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:25:40.528-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:25:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:26:10.809-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:26:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:26:41.118-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:26:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:27:11.400-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:27:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:27:41.712-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:27:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:28:11.995-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:28:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:28:32.319-0500 [conn1523] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T17:28:42.171-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:28:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:29:12.339-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:29:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:29:42.624-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:29:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:30:13.002-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:30:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:30:43.324-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:30:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:31:13.490-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:31:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:31:43.813-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:31:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:32:13.996-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:32:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:32:44.237-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:32:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:33:14.533-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:33:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:33:32.091-0500 [conn1524] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T17:33:44.778-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:33:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:34:15.113-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:34:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:34:45.375-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:34:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:35:15.723-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:35:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:35:45.992-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:35:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:36:16.212-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:36:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:36:46.495-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:36:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:37:16.634-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:37:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:37:46.929-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:37:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:38:17.186-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:38:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:38:32.085-0500 [conn1525] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T17:38:47.491-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:38:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:39:17.783-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:39:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:39:47.940-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:39:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:40:18.231-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:40:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:40:48.529-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:40:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:41:18.733-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:41:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:41:49.003-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:41:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:42:19.298-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:42:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:42:49.624-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:42:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:43:19.922-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:43:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:43:32.204-0500 [conn1526] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T17:43:50.116-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:43:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:44:20.419-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:44:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:44:50.708-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:44:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:45:21.049-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:45:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:45:51.203-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:45:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:46:21.565-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:46:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:46:51.838-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:46:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:47:21.973-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:47:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:47:52.169-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:47:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:48:22.348-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:48:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:48:32.231-0500 [conn1527] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T17:48:52.667-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:48:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:49:22.873-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:49:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:49:53.107-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:49:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:50:23.308-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:50:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:50:53.656-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:50:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:51:23.934-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:51:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:51:54.220-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:51:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:52:24.500-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:52:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:52:54.814-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:52:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:53:25.106-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:53:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:53:32.266-0500 [conn1528] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T17:53:55.399-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:53:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:54:25.693-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:54:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:54:55.967-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:54:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:55:26.257-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:55:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:55:56.529-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:55:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:56:26.822-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:56:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:56:57.059-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:56:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:57:27.359-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:57:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:57:57.651-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:57:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:58:28.088-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:58:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:58:32.075-0500 [conn1529] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T17:58:58.283-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:58:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:59:28.549-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:59:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T17:59:58.839-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 17:59:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:00:29.194-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:00:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:00:59.481-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:00:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:01:29.835-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:01:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:02:00.084-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:01:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:02:30.250-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:02:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:03:00.411-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:03:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:03:30.688-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:03:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:03:32.271-0500 [conn1530] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T18:04:01.025-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:04:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:04:31.357-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:04:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:05:01.487-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:05:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:05:31.755-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:05:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:06:02.024-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:06:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:06:32.320-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:06:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:07:02.614-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:07:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:07:32.919-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:07:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:08:03.144-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:08:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:08:32.290-0500 [conn1531] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T18:08:33.418-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:08:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:09:03.695-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:09:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:09:33.960-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:09:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:10:04.265-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:10:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:10:34.405-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:10:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:11:04.776-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:11:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:11:35.058-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:11:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:12:05.331-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:12:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:12:35.590-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:12:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:13:05.885-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:13:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:13:32.253-0500 [conn1532] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T18:13:36.026-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:13:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:14:06.281-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:14:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:14:36.687-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:14:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:15:06.958-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:15:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:15:37.224-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:15:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:16:07.424-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:16:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:16:37.706-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:16:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:17:08.098-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:17:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:17:38.398-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:17:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:18:08.630-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:18:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:18:32.182-0500 [conn1533] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T18:18:38.917-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:18:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:19:09.207-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:19:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:19:39.340-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:19:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:20:09.680-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:20:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:20:39.833-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:20:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:21:10.117-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:21:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:21:40.450-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:21:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:22:10.738-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:22:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:22:40.880-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:22:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:23:11.163-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:23:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:23:32.240-0500 [conn1534] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T18:23:41.473-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:23:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:24:11.766-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:24:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:24:42.086-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:24:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:25:12.331-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:25:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:25:42.731-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:25:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:26:13.078-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:26:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:26:43.290-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:26:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:27:13.471-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:27:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:27:43.773-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:27:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:28:14.033-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:28:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:28:32.203-0500 [conn1535] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T18:28:44.374-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:28:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:29:14.591-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:29:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:29:44.755-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:29:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:30:14.962-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:30:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:30:45.125-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:30:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:31:15.290-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:31:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:31:45.447-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:31:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:32:15.741-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:32:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:32:46.014-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:32:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:33:16.251-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:33:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:33:32.298-0500 [conn1536] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T18:33:46.521-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:33:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:34:16.687-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:34:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:34:46.911-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:34:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:35:17.182-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:35:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:35:47.379-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:35:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:36:17.758-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:36:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:36:48.036-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:36:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:37:18.204-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:37:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:37:48.573-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:37:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:38:18.963-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:38:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:38:32.152-0500 [conn1537] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T18:38:49.196-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:38:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:39:19.572-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:39:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:39:49.856-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:39:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:40:20.045-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:40:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:40:50.341-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:40:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:41:20.640-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:41:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:41:50.928-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:41:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:42:21.208-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:42:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:42:51.357-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:42:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:43:21.616-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:43:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:43:32.127-0500 [conn1538] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T18:43:51.888-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:43:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:44:22.173-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:44:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:44:52.321-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:44:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:45:22.601-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:45:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:45:52.874-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:45:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:46:23.140-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:46:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:46:53.411-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:46:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:47:23.713-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:47:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:47:53.882-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:47:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:48:24.269-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:48:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:48:32.113-0500 [conn1539] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T18:48:54.420-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:48:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:49:24.726-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:49:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:49:54.978-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:49:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:50:25.299-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:50:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:50:55.445-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:50:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:51:25.678-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:51:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:51:55.834-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:51:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:52:26.150-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:52:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:52:56.400-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:52:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:53:26.654-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:53:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:53:32.081-0500 [conn1540] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T18:53:56.884-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:53:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:54:27.206-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:54:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:54:57.585-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:54:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:55:27.950-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:55:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:55:58.225-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:55:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:56:28.512-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:56:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:56:58.704-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:56:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:57:28.982-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:57:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:57:59.300-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:57:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:58:29.462-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:58:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:58:32.345-0500 [conn1541] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T18:58:59.746-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:58:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T18:59:30.013-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 18:59:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:00:00.310-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:00:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:00:30.581-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:00:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:01:00.861-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:01:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:01:31.036-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:01:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:02:01.377-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:02:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:02:31.639-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:02:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:03:01.825-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:03:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:03:31.984-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:03:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:03:32.156-0500 [conn1542] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T19:04:02.271-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:04:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:04:32.577-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:04:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:05:02.967-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:05:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:05:33.228-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:05:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:06:03.373-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:06:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:06:33.641-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:06:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:07:03.822-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:07:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:07:34.016-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:07:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:08:04.283-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:08:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:08:32.286-0500 [conn1543] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T19:08:34.583-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:08:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:09:04.856-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:09:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:09:35.005-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:09:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:10:05.286-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:10:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:10:35.571-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:10:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:11:05.730-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:11:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:11:36.007-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:11:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:12:06.275-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:12:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:12:36.560-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:12:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:13:06.834-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:13:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:13:32.209-0500 [conn1544] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T19:13:37.046-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:13:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:14:07.316-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:14:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:14:37.591-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:14:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:15:07.897-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:15:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:15:38.203-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:15:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:16:08.463-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:16:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:16:38.843-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:16:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:17:09.125-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:17:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:17:39.416-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:17:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:18:09.803-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:18:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:18:32.227-0500 [conn1545] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T19:18:40.194-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:18:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:19:10.537-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:19:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:19:40.839-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:19:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:20:11.119-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:20:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:20:41.385-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:20:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:21:11.582-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:21:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:21:41.830-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:21:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:22:12.132-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:22:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:22:42.364-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:22:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:23:12.580-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:23:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:23:32.309-0500 [conn1546] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T19:23:42.868-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:23:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:24:13.059-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:24:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:24:43.344-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:24:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:25:13.602-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:25:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:25:43.835-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:25:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:26:14.234-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:26:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:26:44.493-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:26:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:27:14.657-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:27:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:27:44.976-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:27:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:28:15.392-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:28:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:28:32.241-0500 [conn1547] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T19:28:45.772-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:28:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:29:16.041-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:29:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:29:46.194-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:29:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:30:16.483-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:30:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:30:46.640-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:30:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:31:17.045-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:31:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:31:47.350-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:31:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:32:17.612-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:32:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:32:47.903-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:32:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:33:18.217-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:33:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:33:32.266-0500 [conn1548] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T19:33:48.493-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:33:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:34:18.688-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:34:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:34:49.016-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:34:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:35:19.311-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:35:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:35:49.600-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:35:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:36:19.883-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:36:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:36:50.230-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:36:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:37:20.489-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:37:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:37:50.780-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:37:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:38:21.027-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:38:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:38:32.249-0500 [conn1549] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T19:38:51.235-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:38:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:39:21.454-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:39:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:39:51.817-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:39:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:40:21.994-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:40:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:40:52.258-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:40:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:41:22.469-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:41:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:41:52.825-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:41:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:42:23.105-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:42:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:42:53.466-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:42:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:43:23.861-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:43:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:43:32.153-0500 [conn1550] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T19:43:54.136-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:43:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:44:24.388-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:44:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:44:54.663-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:44:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:45:24.940-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:45:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:45:55.222-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:45:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:46:25.429-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:46:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:46:55.716-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:46:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:47:25.858-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:47:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:47:56.140-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:47:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:48:26.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:48:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:48:32.252-0500 [conn1551] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T19:48:56.699-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:48:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:49:26.962-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:49:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:49:57.264-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:49:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:50:27.522-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:50:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:50:57.932-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:50:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:51:28.226-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:51:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:51:58.424-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:51:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:52:28.752-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:52:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:52:58.919-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:52:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:53:29.076-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:53:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:53:32.221-0500 [conn1552] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T19:53:59.373-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:53:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:54:29.602-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:54:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:54:59.982-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:54:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:55:30.245-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:55:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:56:00.439-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:56:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:56:30.753-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:56:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:57:00.968-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:57:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:57:31.122-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:57:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:58:01.297-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:58:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:58:31.553-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:58:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:58:32.312-0500 [conn1553] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T19:59:01.795-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:59:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T19:59:31.978-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 19:59:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:00:02.273-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:00:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:00:32.571-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:00:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:01:02.853-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:01:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:01:33.146-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:01:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:02:03.423-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:02:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:02:33.708-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:02:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:03:03.901-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:03:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:03:32.100-0500 [conn1554] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T20:03:34.369-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:03:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:04:04.754-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:04:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:04:35.016-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:04:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:05:05.353-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:05:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:05:35.564-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:05:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:06:05.870-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:06:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:06:36.059-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:06:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:07:06.299-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:07:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:07:36.600-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:07:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:08:06.882-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:08:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:08:32.213-0500 [conn1555] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T20:08:37.156-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:08:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:09:07.436-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:09:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:09:37.667-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:09:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:10:08.032-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:10:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:10:38.310-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:10:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:11:08.579-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:11:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:11:38.857-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:11:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:12:09.123-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:12:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:12:39.404-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:12:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:13:09.677-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:13:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:13:32.161-0500 [conn1556] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T20:13:39.963-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:13:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:14:10.294-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:14:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:14:40.704-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:14:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:15:11.015-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:15:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:15:41.295-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:15:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:16:11.583-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:16:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:16:41.851-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:16:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:17:12.104-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:17:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:17:42.506-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:17:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:18:12.796-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:18:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:18:32.138-0500 [conn1557] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T20:18:43.115-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:18:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:19:13.259-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:19:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:19:43.481-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:19:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:20:13.876-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:20:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:20:44.144-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:20:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:21:14.324-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:21:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:21:44.598-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:21:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:22:15.018-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:22:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:22:45.311-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:22:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:23:15.596-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:23:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:23:32.255-0500 [conn1558] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T20:23:45.756-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:23:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:24:16.029-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:24:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:24:46.337-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:24:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:25:16.635-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:25:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:25:46.798-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:25:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:26:17.082-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:26:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:26:47.341-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:26:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:27:17.620-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:27:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:27:47.889-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:27:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:28:18.209-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:28:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:28:32.315-0500 [conn1559] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T20:28:48.491-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:28:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:29:18.771-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:29:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:29:49.113-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:29:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:30:19.426-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:30:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:30:49.703-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:30:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:31:19.945-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:31:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:31:50.247-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:31:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:32:20.522-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:32:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:32:50.790-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:32:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:33:21.196-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:33:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:33:32.307-0500 [conn1560] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T20:33:51.380-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:33:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:34:21.648-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:34:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:34:51.926-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:34:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:35:22.238-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:35:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:35:52.515-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:35:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:36:22.719-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:36:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:36:52.863-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:36:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:37:23.153-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:37:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:37:53.279-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:37:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:38:23.571-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:38:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:38:32.289-0500 [conn1561] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T20:38:53.717-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:38:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:39:23.886-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:39:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:39:54.218-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:39:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:40:24.494-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:40:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:40:54.688-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:40:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:41:24.968-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:41:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:41:55.254-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:41:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:42:25.533-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:42:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:42:55.839-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:42:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:43:26.130-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:43:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:43:32.218-0500 [conn1562] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T20:43:56.408-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:43:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:44:26.781-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:44:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:44:57.056-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:44:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:45:27.250-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:45:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:45:57.544-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:45:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:46:27.687-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:46:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:46:58.058-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:46:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:47:28.347-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:47:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:47:58.704-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:47:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:48:28.992-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:48:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:48:32.325-0500 [conn1563] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T20:48:59.305-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:48:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:49:29.549-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:49:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:49:59.844-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:49:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:50:30.114-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:50:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:51:00.515-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:51:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:51:30.816-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:51:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:52:01.029-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:52:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:52:31.308-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:52:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:53:01.471-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:53:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:53:31.765-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:53:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:53:32.252-0500 [conn1564] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T20:54:02.036-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:54:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:54:32.359-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:54:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:55:02.665-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:55:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:55:32.874-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:55:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:56:03.160-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:56:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:56:33.539-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:56:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:57:03.803-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:57:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:57:34.200-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:57:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:58:04.492-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:58:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:58:32.235-0500 [conn1565] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T20:58:34.763-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:58:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:59:04.958-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:59:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T20:59:35.137-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 20:59:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:00:05.425-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:00:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:00:35.843-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:00:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:01:06.186-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:01:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:01:36.473-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:01:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:02:06.651-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:02:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:02:36.840-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:02:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:03:07.156-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:03:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:03:32.271-0500 [conn1566] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T21:03:37.533-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:03:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:04:07.817-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:04:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:04:38.072-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:04:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:05:08.274-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:05:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:05:38.545-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:05:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:06:08.823-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:06:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:06:39.075-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:06:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:07:09.357-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:07:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:07:39.651-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:07:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:08:09.923-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:08:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:08:32.249-0500 [conn1567] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T21:08:40.153-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:08:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:09:10.448-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:09:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:09:40.736-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:09:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:10:11.127-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:10:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:10:41.379-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:10:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:11:11.669-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:11:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:11:41.922-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:11:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:12:12.260-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:12:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:12:42.566-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:12:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:13:12.931-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:13:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:13:32.184-0500 [conn1568] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T21:13:43.219-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:13:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:14:13.514-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:14:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:14:43.794-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:14:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:15:14.077-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:15:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:15:44.346-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:15:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:16:14.582-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:16:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:16:44.851-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:16:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:17:15.137-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:17:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:17:45.500-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:17:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:18:15.783-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:18:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:18:32.203-0500 [conn1569] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T21:18:46.176-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:18:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:19:16.336-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:19:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:19:46.563-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:19:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:20:16.746-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:20:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:20:46.911-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:20:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:21:17.170-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:21:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:21:47.485-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:21:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:22:17.839-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:22:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:22:47.972-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:22:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:23:18.441-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:23:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:23:32.247-0500 [conn1570] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T21:23:48.690-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:23:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:24:19.030-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:24:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:24:49.174-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:24:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:25:19.451-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:25:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:25:49.734-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:25:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:26:19.998-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:26:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:26:50.388-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:26:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:27:20.660-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:27:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:27:50.890-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:27:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:28:21.187-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:28:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:28:32.153-0500 [conn1571] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T21:28:51.471-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:28:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:29:21.808-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:29:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:29:52.138-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:29:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:30:22.385-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:30:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:30:52.689-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:30:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:31:23.006-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:31:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:31:53.211-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:31:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:32:23.595-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:32:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:32:53.911-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:32:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:33:24.111-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:33:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:33:32.164-0500 [conn1572] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T21:33:54.423-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:33:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:34:24.710-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:34:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:34:54.971-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:34:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:35:25.247-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:35:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:35:55.483-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:35:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:36:25.771-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:36:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:36:55.978-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:36:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:37:26.303-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:37:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:37:56.606-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:37:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:38:26.892-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:38:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:38:32.183-0500 [conn1573] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T21:38:57.253-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:38:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:39:27.535-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:39:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:39:57.860-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:39:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:40:28.150-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:40:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:40:58.317-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:40:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:41:28.494-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:41:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:41:58.850-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:41:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:42:29.133-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:42:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:42:59.395-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:42:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:43:29.619-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:43:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:43:32.229-0500 [conn1574] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T21:43:59.899-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:43:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:44:30.197-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:44:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:45:00.486-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:45:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:45:30.779-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:45:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:46:01.072-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:46:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:46:31.334-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:46:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:47:01.530-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:47:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:47:31.784-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:47:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:48:02.043-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:48:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:48:32.255-0500 [conn1575] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T21:48:32.326-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:48:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:49:02.571-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:49:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:49:32.848-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:49:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:50:03.172-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:50:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:50:33.435-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:50:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:51:03.840-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:51:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:51:34.154-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:51:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:52:04.439-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:52:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:52:34.735-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:52:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:53:04.929-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:53:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:53:32.188-0500 [conn1576] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T21:53:35.195-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:53:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:54:05.490-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:54:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:54:35.763-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:54:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:55:05.918-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:55:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:55:36.193-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:55:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:56:06.478-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:56:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:56:36.740-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:56:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:57:06.942-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:57:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:57:37.158-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:57:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:58:07.435-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:58:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:58:32.125-0500 [conn1577] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T21:58:37.740-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:58:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:59:07.998-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:59:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T21:59:38.155-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 21:59:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:00:08.559-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:00:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:00:38.818-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:00:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:01:09.087-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:01:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:01:39.362-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:01:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:02:09.630-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:02:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:02:39.806-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:02:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:03:10.029-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:03:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:03:32.147-0500 [conn1578] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T22:03:40.305-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:03:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:04:10.440-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:04:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:04:40.739-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:04:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:05:11.047-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:05:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:05:41.228-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:05:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:06:11.515-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:06:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:06:41.781-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:06:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:07:12.104-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:07:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:07:42.496-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:07:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:08:12.776-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:08:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:08:32.262-0500 [conn1579] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T22:08:43.035-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:08:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:09:13.179-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:09:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:09:43.610-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:09:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:10:13.997-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:10:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:10:44.197-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:10:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:11:14.468-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:11:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:11:44.661-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:11:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:12:14.957-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:12:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:12:45.251-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:12:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:13:15.557-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:13:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:13:32.142-0500 [conn1580] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T22:13:45.715-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:13:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:14:16.017-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:14:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:14:46.246-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:14:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:15:16.497-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:15:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:15:46.760-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:15:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:16:17.034-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:16:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:16:47.309-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:16:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:17:17.518-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:17:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:17:47.735-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:17:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:18:18.095-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:18:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:18:32.398-0500 [conn1581] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T22:18:48.348-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:18:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:19:18.609-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:19:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:19:48.892-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:19:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:20:19.089-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:20:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:20:49.424-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:20:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:21:19.690-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:21:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:21:50.029-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:21:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:22:20.271-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:22:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:22:50.550-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:22:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:23:20.937-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:23:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:23:32.332-0500 [conn1582] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T22:23:51.230-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:23:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:24:21.429-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:24:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:24:51.708-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:24:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:25:21.911-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:25:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:25:52.120-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:25:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:26:22.343-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:26:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:26:52.525-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:26:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:27:22.872-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:27:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:27:53.152-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:27:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:28:23.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:28:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:28:32.275-0500 [conn1583] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T22:28:53.692-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:28:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:29:24.047-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:29:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:29:54.331-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:29:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:30:24.498-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:30:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:30:54.872-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:30:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:31:25.148-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:31:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:31:55.605-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:31:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:32:25.878-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:32:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:32:56.105-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:32:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:33:26.395-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:33:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:33:32.358-0500 [conn1584] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T22:33:56.592-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:33:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:34:26.931-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:34:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:34:57.216-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:34:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:35:27.509-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:35:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:35:57.911-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:35:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:36:28.217-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:36:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:36:58.449-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:36:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:37:28.728-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:37:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:37:58.993-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:37:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:38:29.271-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:38:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:38:32.153-0500 [conn1585] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T22:38:59.558-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:38:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:39:29.975-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:39:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:40:00.277-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:39:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:40:30.558-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:40:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:41:00.911-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:41:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:41:31.254-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:41:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:42:01.448-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:42:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:42:31.728-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:42:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:43:01.919-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:43:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:43:32.096-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:43:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:43:32.200-0500 [conn1586] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T22:44:02.410-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:44:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:44:32.805-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:44:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:45:03.083-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:45:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:45:33.434-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:45:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:46:03.713-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:46:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:46:33.959-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:46:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:47:04.289-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:47:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:47:34.493-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:47:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:48:04.766-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:48:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:48:32.214-0500 [conn1587] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T22:48:35.043-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:48:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:49:05.269-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:49:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:49:35.538-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:49:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:50:05.804-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:50:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:50:35.994-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:50:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:51:06.324-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:51:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:51:36.591-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:51:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:52:06.872-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:52:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:52:37.327-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:52:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:53:07.705-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:53:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:53:32.334-0500 [conn1588] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T22:53:37.964-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:53:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:54:08.218-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:54:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:54:38.503-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:54:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:55:08.768-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:55:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:55:39.063-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:55:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:56:09.352-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:56:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:56:39.563-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:56:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:57:09.844-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:57:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:57:40.138-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:57:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:58:10.429-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:58:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:58:32.296-0500 [conn1589] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T22:58:40.731-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:58:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:59:10.893-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:59:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T22:59:41.154-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 22:59:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:00:11.348-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:00:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:00:41.487-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:00:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:01:11.782-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:01:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:01:42.095-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:01:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:02:12.511-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:02:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:02:42.708-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:02:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:03:13.091-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:03:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:03:32.310-0500 [conn1590] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T23:03:43.276-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:03:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:04:13.495-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:04:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:04:43.768-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:04:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:05:14.138-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:05:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:05:44.454-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:05:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:06:14.704-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:06:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:06:44.880-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:06:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:07:15.244-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:07:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:07:45.541-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:07:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:08:15.948-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:08:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:08:32.280-0500 [conn1591] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T23:08:46.208-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:08:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:09:16.688-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:09:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:09:46.985-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:09:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:10:17.164-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:10:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:10:47.296-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:10:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:11:17.623-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:11:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:11:47.900-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:11:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:12:18.340-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:12:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:12:48.507-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:12:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:13:18.735-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:13:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:13:32.243-0500 [conn1592] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T23:13:49.050-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:13:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:14:19.314-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:14:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:14:49.742-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:14:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:15:19.924-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:15:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:15:50.287-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:15:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:16:20.438-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:16:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:16:50.619-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:16:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:17:20.884-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:17:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:17:51.030-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:17:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:18:21.222-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:18:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:18:32.185-0500 [conn1593] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T23:18:51.517-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:18:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:19:21.813-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:19:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:19:52.018-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:19:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:20:22.203-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:20:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:20:52.538-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:20:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:21:22.798-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:21:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:21:53.077-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:21:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:22:23.342-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:22:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:22:53.622-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:22:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:23:23.907-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:23:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:23:32.343-0500 [conn1594] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T23:23:54.058-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:23:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:24:24.232-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:24:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:24:54.518-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:24:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:25:24.835-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:25:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:25:54.991-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:25:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:26:25.157-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:26:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:26:55.559-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:26:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:27:25.809-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:27:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:27:55.996-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:27:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:28:26.172-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:28:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:28:32.115-0500 [conn1595] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T23:28:56.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:28:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:29:26.698-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:29:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:29:56.985-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:29:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:30:27.336-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:30:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:30:57.527-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:30:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:31:27.795-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:31:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:31:58.096-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:31:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:32:28.306-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:32:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:32:58.688-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:32:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:33:28.971-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:33:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:33:32.333-0500 [conn1596] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T23:33:59.256-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:33:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:34:29.564-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:34:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:34:59.851-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:34:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:35:30.077-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:35:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:36:00.355-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:36:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:36:30.660-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:36:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:37:00.806-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:37:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:37:31.083-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:37:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:38:01.441-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:38:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:38:31.714-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:38:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:38:32.255-0500 [conn1597] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T23:39:01.988-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:39:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:39:32.232-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:39:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:40:02.500-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:40:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:40:32.889-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:40:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:41:03.063-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:41:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:41:33.383-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:41:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:42:03.583-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:42:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:42:33.744-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:42:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:43:04.127-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:43:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:43:32.284-0500 [conn1598] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T23:43:34.337-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:43:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:44:04.610-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:44:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:44:34.892-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:44:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:45:05.089-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:45:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:45:35.236-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:45:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:46:05.487-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:46:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:46:35.891-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:46:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:47:06.173-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:47:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:47:36.373-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:47:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:48:06.598-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:48:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:48:32.128-0500 [conn1599] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T23:48:36.813-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:48:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:49:07.111-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:49:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:49:37.360-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:49:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:50:07.641-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:50:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:50:37.868-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:50:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:51:08.095-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:51:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:51:38.394-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:51:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:52:08.677-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:52:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:52:38.958-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:52:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:53:09.397-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:53:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:53:32.276-0500 [conn1600] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T23:53:39.795-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:53:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:54:10.086-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:54:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:54:40.298-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:54:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:55:10.556-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:55:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:55:40.974-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:55:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:56:11.237-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:56:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:56:41.625-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:56:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:57:11.993-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:57:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:57:42.270-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:57:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:58:12.573-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:58:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:58:32.111-0500 [conn1601] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-27T23:58:42.829-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:58:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:59:13.577-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:59:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-27T23:59:43.824-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Fri Jan 27 23:59:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:00:14.502-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:00:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:00:36.140-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:00:36.140-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:00:44.788-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:00:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:01:00.632-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588c258bf2367042e84ec6b0') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485579660503), why: "doing balance round", ts: ObjectId('588c258c9527cdec667c124a') } } gle1: { lastOp: Timestamp 1485579660000|9, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 20, writtenTo: null, err: null, waited: 20, ok: 1.0 } gle2: { lastOp: Timestamp 1485500398000|18, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 9, writtenTo: null, err: null, waited: 9, ok: 1.0 } 2017-01-28T00:01:00.641-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-28T00:01:00.641-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:01:15.140-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:01:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:01:15.140-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-28T00:01:15.421-0500 [LockPinger] handled late remove of old distributed lock with ts 588c258c9527cdec667c124a 2017-01-28T00:01:45.595-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:01:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:01:49.406-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:01:49.406-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:02:15.773-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:02:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:02:19.858-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:02:19.885-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:02:26.106-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588c25e1761cca343eeb5442') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485579745945), why: "doing balance round", ts: ObjectId('588c25e19527cdec667c124d') } } gle1: { lastOp: Timestamp 1485579746000|2, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 18, writtenTo: null, err: null, waited: 18, ok: 1.0 } gle2: { lastOp: Timestamp 1485500398000|18, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 31, writtenTo: null, err: null, waited: 31, ok: 1.0 } 2017-01-28T00:02:26.116-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-28T00:02:26.253-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c25e19527cdec667c124d 2017-01-28T00:02:26.992-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:02:33.411-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c25e99527cdec667c124e 2017-01-28T00:02:34.110-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:02:46.068-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:02:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:02:58.545-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:02:58.545-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:03:16.364-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:03:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:03:32.328-0500 [conn1602] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T00:03:35.263-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c26269527cdec667c1250 2017-01-28T00:03:36.073-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:03:46.672-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:03:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:04:06.651-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c26469527cdec667c1251 2017-01-28T00:04:07.390-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:04:16.956-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:04:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:04:25.864-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c26599527cdec667c1252 2017-01-28T00:04:26.461-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:04:44.795-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c266c9527cdec667c1253 2017-01-28T00:04:45.472-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:04:47.373-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:04:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:05:17.782-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:05:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:05:22.184-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c26919527cdec667c1254 2017-01-28T00:05:22.939-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:05:29.283-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c26999527cdec667c1255 2017-01-28T00:05:29.969-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:05:42.361-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c26a69527cdec667c1256 2017-01-28T00:05:43.060-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:05:48.064-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:05:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:06:18.342-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:06:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:06:31.789-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:06:31.789-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:06:48.544-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:06:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:06:56.253-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:06:56.253-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:07:18.866-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:07:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:07:49.218-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:07:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:08:19.378-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:08:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:08:32.097-0500 [conn1603] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T00:08:39.830-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:08:39.830-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:08:49.680-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:08:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:08:58.236-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:08:58.236-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:09:19.994-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:09:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:09:47.046-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588c2799aa6da0fe8d55a650') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485580186855), why: "doing balance round", ts: ObjectId('588c279a9527cdec667c125b') } } gle1: { lastOp: Timestamp 1485580186000|23, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 31, writtenTo: null, err: null, waited: 31, ok: 1.0 } gle2: { lastOp: Timestamp 1485579942000|26, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 26, writtenTo: null, err: null, waited: 26, ok: 1.0 } 2017-01-28T00:09:47.053-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-28T00:09:47.190-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c279a9527cdec667c125b 2017-01-28T00:09:47.896-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:09:50.371-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:09:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:10:20.602-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:10:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:10:24.587-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:10:24.587-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:10:50.745-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:10:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:10:55.005-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:10:55.005-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:11:20.998-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:11:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:11:51.349-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:11:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:12:02.063-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:12:02.063-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:12:21.693-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:12:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:12:50.826-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:12:50.826-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:12:51.956-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:12:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:12:57.048-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:12:57.048-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:13:22.227-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:13:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:13:32.097-0500 [conn1604] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T00:13:33.773-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:13:33.773-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:13:52.513-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:13:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:14:10.441-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c28a29527cdec667c1262 2017-01-28T00:14:11.074-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:14:17.407-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c28a99527cdec667c1263 2017-01-28T00:14:18.076-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:14:22.806-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:14:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:14:36.535-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c28bc9527cdec667c1264 2017-01-28T00:14:37.263-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:14:49.860-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c28c99527cdec667c1265 2017-01-28T00:14:50.531-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:14:52.973-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:14:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:15:02.968-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c28d69527cdec667c1266 2017-01-28T00:15:03.708-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:15:16.161-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c28e49527cdec667c1267 2017-01-28T00:15:16.856-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:15:23.313-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:15:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:15:29.292-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c28f19527cdec667c1268 2017-01-28T00:15:30.106-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:15:42.389-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:15:42.389-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:15:53.658-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:15:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:15:54.648-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588c2909c526e01db2622f54') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485580554551), why: "doing balance round", ts: ObjectId('588c290a9527cdec667c126a') } } gle1: { lastOp: Timestamp 1485580554000|16, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 8, writtenTo: null, err: null, waited: 8, ok: 1.0 } gle2: { lastOp: Timestamp 1485580530000|2, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 6, writtenTo: null, err: null, waited: 6, ok: 1.0 } 2017-01-28T00:15:54.656-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-28T00:15:54.656-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:16:23.972-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:16:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:16:23.972-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-28T00:16:24.115-0500 [LockPinger] handled late remove of old distributed lock with ts 588c290a9527cdec667c126a 2017-01-28T00:16:25.286-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:16:25.286-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:16:54.387-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:16:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:17:01.776-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:17:01.776-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:17:07.982-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c29539527cdec667c126d 2017-01-28T00:17:08.751-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:17:24.711-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:17:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:17:39.357-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c29739527cdec667c126e 2017-01-28T00:17:40.100-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:17:52.525-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c29809527cdec667c126f 2017-01-28T00:17:53.235-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:17:55.027-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:17:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:18:05.452-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:18:05.452-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:18:23.943-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c299f9527cdec667c1271 2017-01-28T00:18:24.538-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:18:25.294-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:18:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:18:32.141-0500 [conn1605] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T00:18:37.100-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c29ac9527cdec667c1272 2017-01-28T00:18:37.770-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:18:50.108-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c29b99527cdec667c1273 2017-01-28T00:18:50.807-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:18:55.618-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:18:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:19:15.274-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588c29d289b67e1cf674ca89') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485580755128), why: "doing balance round", ts: ObjectId('588c29d39527cdec667c1274') } } gle1: { lastOp: Timestamp 1485580755000|7, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 20, writtenTo: null, err: null, waited: 20, ok: 1.0 } gle2: { lastOp: Timestamp 1485580730000|21, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 13, writtenTo: null, err: null, waited: 13, ok: 1.0 } 2017-01-28T00:19:15.281-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-28T00:19:15.281-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:19:25.972-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:19:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:19:25.972-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-28T00:19:26.129-0500 [LockPinger] handled late remove of old distributed lock with ts 588c29d39527cdec667c1274 2017-01-28T00:19:39.851-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c29eb9527cdec667c1275 2017-01-28T00:19:40.480-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:19:56.387-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:19:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:20:10.970-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:20:10.970-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:20:17.307-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c2a119527cdec667c1277 2017-01-28T00:20:17.908-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:20:24.247-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c2a179527cdec667c1278 2017-01-28T00:20:24.978-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:20:26.592-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:20:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:20:49.646-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c2a319527cdec667c1279 2017-01-28T00:20:50.271-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:20:56.628-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c2a389527cdec667c127a 2017-01-28T00:20:56.873-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:20:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:20:57.365-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:21:09.760-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c2a459527cdec667c127b 2017-01-28T00:21:10.462-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:21:27.270-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:21:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:21:28.912-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c2a589527cdec667c127c 2017-01-28T00:21:29.670-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:21:42.119-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c2a659527cdec667c127d 2017-01-28T00:21:42.850-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:21:55.197-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c2a739527cdec667c127e 2017-01-28T00:21:55.894-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:21:57.556-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:21:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:22:08.347-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c2a809527cdec667c127f 2017-01-28T00:22:09.107-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:22:27.939-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:22:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:22:58.242-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:22:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:23:28.520-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:23:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:23:32.254-0500 [conn1606] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T00:23:34.201-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c2ad69527cdec667c1280 2017-01-28T00:23:35.006-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:23:58.800-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:23:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:24:23.801-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c2b079527cdec667c1281 2017-01-28T00:24:24.510-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:24:29.088-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:24:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:24:48.921-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c2b209527cdec667c1282 2017-01-28T00:24:49.702-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:24:55.983-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c2b279527cdec667c1283 2017-01-28T00:24:56.680-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:24:59.259-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:24:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:25:02.996-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c2b2e9527cdec667c1284 2017-01-28T00:25:03.767-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:25:29.441-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:25:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:25:59.589-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:25:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:26:16.726-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:26:16.726-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:26:22.886-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:26:22.886-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:26:29.878-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:26:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:26:59.527-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:26:59.527-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:27:00.155-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:26:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:27:11.915-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588c2baeb081817bb2461f73') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485581231768), why: "doing balance round", ts: ObjectId('588c2baf9527cdec667c1288') } } gle1: { lastOp: Timestamp 1485581231000|19, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 6, writtenTo: null, err: null, waited: 6, ok: 1.0 } gle2: { lastOp: Timestamp 1485581103000|17, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 33, writtenTo: null, err: null, waited: 33, ok: 1.0 } 2017-01-28T00:27:11.921-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-28T00:27:11.921-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:27:30.424-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:27:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:27:30.424-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-28T00:27:30.565-0500 [LockPinger] handled late remove of old distributed lock with ts 588c2baf9527cdec667c1288 2017-01-28T00:28:00.564-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:28:00.564-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:28:00.742-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:28:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:28:06.962-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c2be69527cdec667c128a 2017-01-28T00:28:07.638-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:28:13.900-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c2bed9527cdec667c128b 2017-01-28T00:28:14.530-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:28:30.895-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:28:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:28:32.074-0500 [conn1607] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T00:28:51.483-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c2c139527cdec667c128c 2017-01-28T00:28:52.199-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:29:01.205-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:29:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:29:31.498-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:29:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:30:01.782-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:30:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:30:32.061-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:30:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:30:35.631-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:30:35.631-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:31:02.360-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:31:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:31:32.699-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:31:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:31:42.494-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:31:42.494-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:32:00.927-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:32:00.928-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:32:03.032-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:32:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:32:19.564-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c2ce39527cdec667c1290 2017-01-28T00:32:20.227-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:32:26.636-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c2cea9527cdec667c1291 2017-01-28T00:32:27.398-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:32:33.337-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:32:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:32:33.762-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c2cf19527cdec667c1292 2017-01-28T00:32:34.438-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:33:03.683-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:33:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:33:11.116-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c2d169527cdec667c1293 2017-01-28T00:33:11.914-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:33:18.349-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c2d1d9527cdec667c1294 2017-01-28T00:33:19.143-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:33:25.493-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c2d259527cdec667c1295 2017-01-28T00:33:26.266-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:33:32.098-0500 [conn1608] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T00:33:33.942-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:33:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:34:04.100-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:34:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:34:08.884-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:34:08.884-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:34:15.104-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:34:15.104-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:34:21.270-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:34:21.270-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:34:34.422-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:34:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:35:04.700-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:35:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:35:34.359-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588c2da50a9af2c9c41ada44') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485581734194), why: "doing balance round", ts: ObjectId('588c2da69527cdec667c1299') } } gle1: { lastOp: Timestamp 1485581606000|3, connectionId: 21778, updatedExisting: false, n: 0, syncMillis: 6, writtenTo: null, err: null, waited: 6, ok: 1.0 } gle2: { lastOp: Timestamp 1485581734000|8, connectionId: 6379656, updatedExisting: true, n: 1, syncMillis: 32, writtenTo: null, err: null, waited: 32, ok: 1.0 } 2017-01-28T00:35:34.366-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-28T00:35:34.366-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:35:35.072-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:35:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:35:35.072-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-28T00:35:35.211-0500 [LockPinger] handled late remove of old distributed lock with ts 588c2da69527cdec667c1299 2017-01-28T00:35:40.572-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:35:40.572-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:35:52.895-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c2db89527cdec667c129b 2017-01-28T00:35:53.504-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:35:59.851-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c2dbf9527cdec667c129c 2017-01-28T00:36:00.548-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:36:05.501-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:36:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:36:06.791-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:36:06.791-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:36:12.931-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:36:12.931-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:36:25.343-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c2dd99527cdec667c129f 2017-01-28T00:36:25.967-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:36:32.256-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c2de09527cdec667c12a0 2017-01-28T00:36:32.903-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:36:35.955-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:36:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:37:06.430-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:37:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:37:09.449-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:37:09.450-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:37:36.708-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:37:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:38:07.124-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:38:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:38:22.353-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588c2e4d761cca343eeb548c') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485581902258), why: "doing balance round", ts: ObjectId('588c2e4e9527cdec667c12a2') } } gle1: { lastOp: Timestamp 1485581902000|18, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 3, writtenTo: null, err: null, waited: 3, ok: 1.0 } gle2: { lastOp: Timestamp 1485581792000|30, connectionId: 393608, updatedExisting: false, n: 0, syncMillis: 19, writtenTo: null, err: null, waited: 19, ok: 1.0 } 2017-01-28T00:38:22.360-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-28T00:38:22.360-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:38:32.173-0500 [conn1609] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T00:38:37.497-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:38:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:38:37.497-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-28T00:38:37.716-0500 [LockPinger] handled late remove of old distributed lock with ts 588c2e4e9527cdec667c12a2 2017-01-28T00:39:05.044-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:39:05.044-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:39:07.907-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:39:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:39:38.214-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:39:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:39:53.761-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588c2ea8ca3906e0a9d42613') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485581993592), why: "doing balance round", ts: ObjectId('588c2ea99527cdec667c12a4') } } gle1: { lastOp: Timestamp 1485581993000|17, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 7, writtenTo: null, err: null, waited: 7, ok: 1.0 } gle2: { lastOp: Timestamp 1485581902000|18, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 30, writtenTo: null, err: null, waited: 30, ok: 1.0 } 2017-01-28T00:39:53.770-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-28T00:39:53.941-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c2ea99527cdec667c12a4 2017-01-28T00:39:54.494-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:40:00.897-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c2eb09527cdec667c12a5 2017-01-28T00:40:01.711-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:40:08.511-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:40:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:40:26.216-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:40:26.216-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:40:38.812-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:40:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:41:02.735-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:41:02.735-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:41:09.002-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:41:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:41:33.280-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:41:33.280-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:41:39.363-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:41:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:41:57.778-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:41:57.778-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:42:09.662-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:42:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:42:39.922-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:42:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:42:46.635-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c2f569527cdec667c12aa 2017-01-28T00:42:47.303-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:43:10.212-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:43:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:43:11.962-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c2f6f9527cdec667c12ab 2017-01-28T00:43:12.661-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:43:18.994-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c2f769527cdec667c12ac 2017-01-28T00:43:19.626-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:43:32.298-0500 [conn1610] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T00:43:40.447-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:43:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:43:50.325-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c2f969527cdec667c12ad 2017-01-28T00:43:50.992-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:44:10.776-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:44:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:44:39.867-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c2fc79527cdec667c12ae 2017-01-28T00:44:40.688-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:44:41.081-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:44:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:44:59.181-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c2fda9527cdec667c12af 2017-01-28T00:44:59.881-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:45:11.244-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:45:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:45:41.487-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:45:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:45:42.521-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c30069527cdec667c12b0 2017-01-28T00:45:43.160-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:46:11.956-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:46:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:46:19.874-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:46:19.874-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:46:26.034-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:46:26.034-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:46:42.201-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:46:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:46:56.678-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588c304f85950f1c7b9d938d') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485582416559), why: "doing balance round", ts: ObjectId('588c30509527cdec667c12b3') } } gle1: { lastOp: Timestamp 1485582343000|9, connectionId: 21778, updatedExisting: false, n: 0, syncMillis: 29, writtenTo: null, err: null, waited: 29, ok: 1.0 } gle2: { lastOp: Timestamp 1485582416000|15, connectionId: 6379656, updatedExisting: true, n: 1, syncMillis: 23, writtenTo: null, err: null, waited: 23, ok: 1.0 } 2017-01-28T00:46:56.764-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-28T00:46:56.890-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c30509527cdec667c12b3 2017-01-28T00:46:57.623-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:47:12.566-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:47:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:47:28.266-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588c306f62e531ebd966d007') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485582448129), why: "doing balance round", ts: ObjectId('588c30709527cdec667c12b4') } } gle1: { lastOp: Timestamp 1485582417000|12, connectionId: 21778, updatedExisting: false, n: 0, syncMillis: 10, writtenTo: null, err: null, waited: 10, ok: 1.0 } gle2: { lastOp: Timestamp 1485582448000|5, connectionId: 393608, updatedExisting: true, n: 1, syncMillis: 18, writtenTo: null, err: null, waited: 18, ok: 1.0 } 2017-01-28T00:47:28.273-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-28T00:47:28.273-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:47:40.535-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588c307b331a0d8ab511d328') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485582460390), why: "doing balance round", ts: ObjectId('588c307c9527cdec667c12b5') } } gle1: { lastOp: Timestamp 1485582460000|12, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 18, writtenTo: null, err: null, waited: 18, ok: 1.0 } gle2: { lastOp: Timestamp 1485582417000|12, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 22, writtenTo: null, err: null, waited: 22, ok: 1.0 } 2017-01-28T00:47:40.542-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-28T00:47:40.542-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:47:42.901-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:47:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:47:42.901-0500 [LockPinger] trying to delete 2 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-28T00:47:43.078-0500 [LockPinger] handled late remove of old distributed lock with ts 588c30709527cdec667c12b4 2017-01-28T00:47:43.218-0500 [LockPinger] handled late remove of old distributed lock with ts 588c307c9527cdec667c12b5 2017-01-28T00:47:46.887-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c30829527cdec667c12b6 2017-01-28T00:47:47.589-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:48:13.366-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:48:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:48:32.159-0500 [conn1611] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T00:48:43.593-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:48:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:49:13.875-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:49:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:49:37.049-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:49:37.049-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:49:44.122-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:49:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:50:07.616-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588c310e47420e2d53cb5df1') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485582607460), why: "doing balance round", ts: ObjectId('588c310f9527cdec667c12b8') } } gle1: { lastOp: Timestamp 1485582607000|17, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 18, writtenTo: null, err: null, waited: 18, ok: 1.0 } gle2: { lastOp: Timestamp 1485582467000|13, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 21, writtenTo: null, err: null, waited: 21, ok: 1.0 } 2017-01-28T00:50:07.635-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-28T00:50:07.831-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c310f9527cdec667c12b8 2017-01-28T00:50:08.557-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:50:14.474-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:50:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:50:14.838-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c31169527cdec667c12b9 2017-01-28T00:50:15.428-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:50:21.835-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c311d9527cdec667c12ba 2017-01-28T00:50:22.532-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:50:40.962-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c31309527cdec667c12bb 2017-01-28T00:50:41.523-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:50:44.766-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:50:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:50:53.941-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c313d9527cdec667c12bc 2017-01-28T00:50:54.608-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:51:15.074-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:51:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:51:19.005-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:51:19.005-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:51:45.355-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:51:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:52:13.740-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:52:13.740-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:52:15.636-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:52:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:52:19.991-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:52:19.991-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:52:32.292-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:52:32.292-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:52:44.775-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c31ac9527cdec667c12c1 2017-01-28T00:52:45.441-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:52:45.835-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:52:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:53:03.919-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c31bf9527cdec667c12c2 2017-01-28T00:53:04.723-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:53:16.156-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:53:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:53:16.982-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c31cc9527cdec667c12c3 2017-01-28T00:53:17.672-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:53:24.131-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c31d39527cdec667c12c4 2017-01-28T00:53:24.898-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:53:32.251-0500 [conn1612] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T00:53:46.480-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:53:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:53:49.434-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:53:49.434-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:54:16.813-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:54:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:54:47.083-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:54:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:54:56.475-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c32309527cdec667c12c6 2017-01-28T00:54:57.147-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:55:15.488-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:55:15.488-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:55:17.374-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:55:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:55:21.695-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c32499527cdec667c12c8 2017-01-28T00:55:22.327-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:55:40.635-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:55:40.635-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:55:47.634-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:55:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:56:17.874-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:56:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:56:35.424-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:56:35.425-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:56:41.642-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:56:41.642-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:56:48.181-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:56:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:57:12.142-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:57:12.142-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T00:57:18.515-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:57:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:57:48.752-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:57:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:58:19.036-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:58:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:58:25.459-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c33019527cdec667c12cd 2017-01-28T00:58:26.095-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:58:32.255-0500 [conn1613] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T00:58:44.724-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c33149527cdec667c12ce 2017-01-28T00:58:45.421-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:58:49.332-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:58:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:58:51.779-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c331b9527cdec667c12cf 2017-01-28T00:58:52.476-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:59:04.935-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c33289527cdec667c12d0 2017-01-28T00:59:05.528-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:59:17.958-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c33359527cdec667c12d1 2017-01-28T00:59:18.635-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T00:59:19.591-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:59:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:59:49.906-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 00:59:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T00:59:55.233-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T00:59:55.233-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:00:20.163-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:00:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:00:50.317-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:00:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:01:20.367-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:01:20.367-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:01:20.630-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:01:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:01:50.965-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:01:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:02:21.258-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:02:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:02:27.493-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:02:27.493-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:02:33.694-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:02:33.695-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:02:51.396-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:02:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:03:21.549-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:03:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:03:28.404-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c34309527cdec667c12d6 2017-01-28T01:03:29.067-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T01:03:32.230-0500 [conn1614] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T01:03:47.416-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c34439527cdec667c12d7 2017-01-28T01:03:48.049-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T01:03:51.847-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:03:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:04:22.040-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:04:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:04:24.717-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c34689527cdec667c12d8 2017-01-28T01:04:25.410-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T01:04:31.874-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c346f9527cdec667c12d9 2017-01-28T01:04:32.615-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T01:04:38.951-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c34769527cdec667c12da 2017-01-28T01:04:39.805-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T01:04:52.330-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:04:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:04:58.293-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c348a9527cdec667c12db 2017-01-28T01:04:58.991-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T01:05:11.424-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:05:11.424-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:05:22.612-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:05:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:05:35.856-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:05:35.856-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:05:52.929-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:05:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:06:06.410-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:06:06.410-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:06:23.214-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:06:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:06:30.824-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:06:30.824-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:06:53.358-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:06:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:07:19.509-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:07:19.509-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:07:23.635-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:07:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:07:53.806-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:07:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:08:02.081-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:08:02.081-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:08:08.249-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:08:08.249-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:08:14.468-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:08:14.468-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:08:24.013-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:08:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:08:32.129-0500 [conn1615] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T01:08:54.221-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:08:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:09:24.494-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:09:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:09:54.650-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:09:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:10:24.922-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:10:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:10:46.317-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:10:46.317-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:10:55.124-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:10:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:11:25.401-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:11:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:11:55.665-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:11:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:12:23.716-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:12:23.716-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:12:25.827-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:12:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:12:56.124-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:12:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:13:06.682-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c36729527cdec667c12e6 2017-01-28T01:13:07.352-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T01:13:26.362-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:13:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:13:32.182-0500 [conn1616] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T01:13:56.652-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:13:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:14:02.095-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:14:02.095-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:14:26.957-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:14:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:14:57.263-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:14:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:15:27.555-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:15:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:15:57.859-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:15:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:16:28.128-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:16:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:16:33.919-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:16:33.919-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:16:40.065-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:16:40.065-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:16:58.366-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:16:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:16:58.479-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:16:58.479-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:17:10.778-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:17:10.778-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:17:28.659-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:17:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:17:47.283-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:17:47.283-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:17:58.901-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:17:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:18:29.174-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:18:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:18:32.215-0500 [conn1617] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T01:18:42.281-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c37c29527cdec667c12ed 2017-01-28T01:18:42.977-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T01:18:49.450-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c37c99527cdec667c12ee 2017-01-28T01:18:50.183-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T01:18:59.475-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:18:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:19:02.589-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c37d69527cdec667c12ef 2017-01-28T01:19:03.286-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T01:19:27.911-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c37ef9527cdec667c12f0 2017-01-28T01:19:28.647-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T01:19:29.822-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:19:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:19:35.019-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c37f69527cdec667c12f1 2017-01-28T01:19:35.756-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T01:19:42.127-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c37fd9527cdec667c12f2 2017-01-28T01:19:42.843-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T01:19:49.215-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c38049527cdec667c12f3 2017-01-28T01:19:49.921-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T01:20:00.123-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:19:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:20:08.285-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c38189527cdec667c12f4 2017-01-28T01:20:09.034-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T01:20:30.390-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:20:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:20:33.742-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c38319527cdec667c12f5 2017-01-28T01:20:34.366-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T01:20:53.019-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c38449527cdec667c12f6 2017-01-28T01:20:53.892-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T01:21:00.605-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:21:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:21:12.469-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c38589527cdec667c12f7 2017-01-28T01:21:13.204-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T01:21:30.887-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:21:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:21:37.639-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588c3870b081817bb2461fc6') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485584497492), why: "doing balance round", ts: ObjectId('588c38719527cdec667c12f8') } } gle1: { lastOp: Timestamp 1485584497000|11, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 17, writtenTo: null, err: null, waited: 17, ok: 1.0 } gle2: { lastOp: Timestamp 1485584473000|2, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 30, writtenTo: null, err: null, waited: 30, ok: 1.0 } 2017-01-28T01:21:37.646-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-28T01:21:37.646-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:22:01.189-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:22:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:22:01.189-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-28T01:22:01.328-0500 [LockPinger] handled late remove of old distributed lock with ts 588c38719527cdec667c12f8 2017-01-28T01:22:08.250-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:22:08.250-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:22:31.593-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:22:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:22:44.919-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:22:44.919-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:23:01.867-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:23:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:23:21.537-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:23:21.537-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:23:32.148-0500 [conn1618] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T01:23:32.150-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:23:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:24:02.451-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:24:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:24:32.768-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:24:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:24:34.694-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:24:34.694-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:24:59.231-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588c393a2cf29185e4b13966') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485584699051), why: "doing balance round", ts: ObjectId('588c393b9527cdec667c12fd') } } gle1: { lastOp: Timestamp 1485584699000|3, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 17, writtenTo: null, err: null, waited: 17, ok: 1.0 } gle2: { lastOp: Timestamp 1485584473000|2, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 7, writtenTo: null, err: null, waited: 7, ok: 1.0 } 2017-01-28T01:24:59.241-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-28T01:24:59.306-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c393b9527cdec667c12fd 2017-01-28T01:25:00.047-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T01:25:03.080-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:25:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:25:24.673-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c39549527cdec667c12fe 2017-01-28T01:25:25.338-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T01:25:33.352-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:25:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:25:37.722-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c39619527cdec667c12ff 2017-01-28T01:25:38.441-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T01:25:50.899-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c396e9527cdec667c1300 2017-01-28T01:25:51.545-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T01:26:03.600-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:26:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:26:21.980-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:26:21.980-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:26:33.886-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:26:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:27:04.037-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:27:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:27:10.685-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:27:10.685-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:27:23.023-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:27:23.023-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:27:29.300-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:27:29.300-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:27:34.218-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:27:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:28:04.354-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:28:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:28:05.974-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:28:05.974-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:28:32.250-0500 [conn1619] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T01:28:34.617-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:28:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:28:48.746-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c3a209527cdec667c1306 2017-01-28T01:28:49.439-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T01:29:01.819-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:29:01.819-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:29:04.876-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:29:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:29:14.094-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:29:14.094-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:29:32.595-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:29:32.595-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:29:35.327-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:29:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:29:38.805-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:29:38.805-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:29:57.175-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:29:57.175-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:30:05.598-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:30:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:30:09.455-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:30:09.455-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:30:33.946-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:30:33.946-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:30:35.896-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:30:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:31:06.209-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:31:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:31:10.550-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:31:10.550-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:31:36.551-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:31:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:32:06.730-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:32:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:32:37.143-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:32:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:33:00.177-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:33:00.177-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:33:07.470-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:33:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:33:12.598-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c3b289527cdec667c1310 2017-01-28T01:33:13.300-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T01:33:32.281-0500 [conn1620] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T01:33:37.863-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:33:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:33:43.760-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:33:43.760-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:34:02.127-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:34:02.127-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:34:08.172-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:34:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:34:20.487-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:34:20.487-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:34:38.471-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:34:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:35:03.256-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:35:03.257-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:35:08.632-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:35:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:35:38.905-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:35:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:35:52.057-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:35:52.057-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:36:09.197-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:36:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:36:39.376-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:36:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:36:40.866-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c3bf89527cdec667c1316 2017-01-28T01:36:41.469-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T01:37:09.786-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:37:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:37:39.944-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:37:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:38:00.537-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:38:00.537-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:38:06.791-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:38:06.791-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:38:10.229-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:38:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:38:32.171-0500 [conn1621] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T01:38:37.448-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c3c6d9527cdec667c1319 2017-01-28T01:38:38.152-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T01:38:40.584-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:38:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:39:10.723-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:39:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:39:14.687-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588c3c91ee2ebe2ebd3ce0b6') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485585554559), why: "doing balance round", ts: ObjectId('588c3c929527cdec667c131a') } } gle1: { lastOp: Timestamp 1485585554000|12, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 27, writtenTo: null, err: null, waited: 27, ok: 1.0 } gle2: { lastOp: Timestamp 1485585518000|4, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 30, writtenTo: null, err: null, waited: 30, ok: 1.0 } 2017-01-28T01:39:14.693-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-28T01:39:14.693-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:39:41.063-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:39:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:39:41.063-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-28T01:39:41.200-0500 [LockPinger] handled late remove of old distributed lock with ts 588c3c929527cdec667c131a 2017-01-28T01:40:11.369-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:40:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:40:22.078-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c3cd59527cdec667c131b 2017-01-28T01:40:22.740-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T01:40:29.099-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c3cdc9527cdec667c131c 2017-01-28T01:40:29.720-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T01:40:41.595-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:40:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:40:42.086-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:40:42.087-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:41:06.502-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c3d029527cdec667c131e 2017-01-28T01:41:07.145-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T01:41:11.874-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:41:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:41:42.145-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:41:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:42:12.481-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:42:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:42:38.596-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:42:38.596-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:42:42.751-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:42:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:42:50.921-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588c3d6a71709c8a0564b37f') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485585770818), why: "doing balance round", ts: ObjectId('588c3d6a9527cdec667c1320') } } gle1: { lastOp: Timestamp 1485585667000|8, connectionId: 21778, updatedExisting: false, n: 0, syncMillis: 2, writtenTo: null, err: null, waited: 2, ok: 1.0 } gle2: { lastOp: Timestamp 1485585770000|32, connectionId: 393608, updatedExisting: true, n: 1, syncMillis: 13, writtenTo: null, err: null, waited: 13, ok: 1.0 } 2017-01-28T01:42:50.931-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-28T01:42:51.030-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c3d6a9527cdec667c1320 2017-01-28T01:42:51.590-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T01:42:57.819-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c3d719527cdec667c1321 2017-01-28T01:42:58.378-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T01:43:10.749-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c3d7e9527cdec667c1322 2017-01-28T01:43:11.356-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T01:43:13.087-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:43:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:43:17.673-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:43:17.673-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:43:30.085-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c3d919527cdec667c1324 2017-01-28T01:43:30.820-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T01:43:32.132-0500 [conn1622] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T01:43:37.309-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c3d989527cdec667c1325 2017-01-28T01:43:38.011-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T01:43:43.424-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:43:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:44:02.735-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c3db29527cdec667c1326 2017-01-28T01:44:03.631-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T01:44:13.704-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:44:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:44:16.096-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c3dbf9527cdec667c1327 2017-01-28T01:44:16.800-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T01:44:29.343-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c3dcc9527cdec667c1328 2017-01-28T01:44:30.142-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T01:44:42.419-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c3dda9527cdec667c1329 2017-01-28T01:44:42.989-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T01:44:43.989-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:44:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:44:55.356-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:44:55.356-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:45:01.562-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588c3dec5335c06abbd15bf2') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485585901417), why: "doing balance round", ts: ObjectId('588c3ded9527cdec667c132b') } } gle1: { lastOp: Timestamp 1485585882000|36, connectionId: 21778, updatedExisting: false, n: 0, syncMillis: 4, writtenTo: null, err: null, waited: 4, ok: 1.0 } gle2: { lastOp: Timestamp 1485585901000|17, connectionId: 393608, updatedExisting: true, n: 1, syncMillis: 15, writtenTo: null, err: null, waited: 15, ok: 1.0 } 2017-01-28T01:45:01.571-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-28T01:45:01.671-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c3ded9527cdec667c132b 2017-01-28T01:45:02.341-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T01:45:14.308-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:45:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:45:44.610-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:45:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:46:03.229-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588c3e2aca3906e0a9d426a2') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485585963153), why: "doing balance round", ts: ObjectId('588c3e2b9527cdec667c132c') } } gle1: { lastOp: Timestamp 1485585963000|6, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 19, writtenTo: null, err: null, waited: 19, ok: 1.0 } gle2: { lastOp: Timestamp 1485585902000|3, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 4, writtenTo: null, err: null, waited: 4, ok: 1.0 } 2017-01-28T01:46:03.236-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-28T01:46:03.236-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:46:14.896-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:46:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:46:14.896-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-28T01:46:15.033-0500 [LockPinger] handled late remove of old distributed lock with ts 588c3e2b9527cdec667c132c 2017-01-28T01:46:27.716-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:46:27.716-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:46:45.305-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:46:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:46:58.128-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:46:58.128-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:47:15.603-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:47:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:47:16.555-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:47:16.555-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:47:45.843-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:47:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:48:11.486-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:48:11.486-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:48:16.148-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:48:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:48:32.276-0500 [conn1623] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T01:48:46.340-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:48:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:48:54.313-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:48:54.313-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:49:16.638-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:49:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:49:36.923-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:49:36.923-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:49:43.182-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:49:43.182-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:49:47.111-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:49:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:50:17.397-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:50:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:50:44.074-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:50:44.074-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:50:47.694-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:50:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:51:17.991-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:51:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:51:48.272-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:51:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:52:18.706-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:52:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:52:27.485-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:52:27.485-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:52:48.999-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:52:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:53:04.016-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:53:04.016-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:53:19.297-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:53:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:53:22.371-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:53:22.371-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:53:32.294-0500 [conn1624] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T01:53:49.451-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:53:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:54:19.765-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:54:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:54:41.510-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:54:41.511-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:54:47.803-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:54:47.803-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:54:50.088-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:54:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:55:06.218-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c404a9527cdec667c133a 2017-01-28T01:55:06.846-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T01:55:13.156-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c40509527cdec667c133b 2017-01-28T01:55:13.890-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T01:55:20.346-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:55:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:55:32.397-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c40649527cdec667c133c 2017-01-28T01:55:33.107-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T01:55:50.633-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:55:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:56:03.633-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:56:03.633-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:56:09.847-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:56:09.848-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:56:16.017-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:56:16.017-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:56:20.874-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:56:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:56:51.147-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:56:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:57:21.507-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:57:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:57:47.196-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:57:47.197-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:57:51.811-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:57:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:57:59.624-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c40f79527cdec667c1341 2017-01-28T01:58:00.289-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T01:58:22.186-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:58:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:58:30.879-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c41169527cdec667c1342 2017-01-28T01:58:31.615-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T01:58:32.223-0500 [conn1625] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T01:58:52.585-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:58:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:59:21.007-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:59:21.007-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:59:22.843-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:59:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:59:33.255-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:59:33.255-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:59:39.663-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-28T01:59:39.663-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-28T01:59:53.184-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 01:59:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T01:59:58.145-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588c416d9527cdec667c1346 2017-01-28T01:59:58.863-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-28T02:00:23.609-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:00:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:00:53.817-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:00:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:01:24.012-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:01:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:01:54.476-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:01:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:02:24.672-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:02:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:02:55.150-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:02:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:03:25.427-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:03:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:03:32.075-0500 [conn1626] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T02:03:55.699-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:03:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:04:25.853-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:04:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:04:56.106-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:04:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:05:26.392-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:05:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:05:56.757-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:05:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:06:27.041-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:06:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:06:57.346-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:06:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:07:27.615-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:07:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:07:57.910-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:07:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:08:28.160-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:08:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:08:32.290-0500 [conn1627] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T02:08:58.351-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:08:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:09:28.607-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:09:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:09:58.964-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:09:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:10:29.211-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:10:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:10:59.473-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:10:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:11:29.756-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:11:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:12:00.034-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:11:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:12:30.301-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:12:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:13:00.582-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:13:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:13:30.846-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:13:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:13:32.242-0500 [conn1628] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T02:14:00.994-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:14:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:14:31.205-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:14:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:15:01.445-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:15:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:15:31.730-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:15:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:16:01.862-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:16:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:16:32.030-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:16:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:17:02.333-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:17:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:17:32.597-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:17:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:18:02.898-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:18:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:18:32.225-0500 [conn1629] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T02:18:33.158-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:18:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:19:03.429-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:19:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:19:33.731-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:19:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:20:03.899-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:20:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:20:34.162-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:20:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:21:04.603-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:21:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:21:34.878-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:21:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:22:05.132-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:22:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:22:35.393-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:22:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:23:05.648-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:23:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:23:32.247-0500 [conn1630] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T02:23:35.904-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:23:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:24:06.269-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:24:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:24:36.523-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:24:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:25:06.811-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:25:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:25:37.094-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:25:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:26:07.388-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:26:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:26:37.683-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:26:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:27:07.974-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:27:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:27:38.315-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:27:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:28:08.514-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:28:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:28:32.181-0500 [conn1631] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T02:28:38.668-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:28:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:29:08.932-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:29:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:29:39.142-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:29:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:30:09.446-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:30:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:30:39.925-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:30:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:31:10.205-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:31:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:31:40.497-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:31:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:32:10.633-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:32:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:32:41.024-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:32:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:33:11.291-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:33:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:33:32.271-0500 [conn1632] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T02:33:41.647-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:33:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:34:11.805-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:34:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:34:42.145-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:34:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:35:12.402-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:35:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:35:42.675-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:35:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:36:12.968-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:36:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:36:43.248-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:36:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:37:13.530-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:37:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:37:43.666-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:37:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:38:13.940-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:38:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:38:32.263-0500 [conn1633] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T02:38:44.147-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:38:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:39:14.490-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:39:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:39:44.648-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:39:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:40:14.843-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:40:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:40:45.152-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:40:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:41:15.474-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:41:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:41:45.659-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:41:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:42:15.948-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:42:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:42:46.233-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:42:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:43:16.573-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:43:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:43:32.097-0500 [conn1634] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T02:43:46.845-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:43:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:44:17.194-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:44:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:44:47.430-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:44:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:45:17.778-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:45:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:45:48.041-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:45:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:46:18.331-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:46:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:46:48.696-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:46:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:47:19.138-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:47:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:47:49.436-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:47:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:48:19.746-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:48:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:48:32.124-0500 [conn1635] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T02:48:50.023-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:48:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:49:20.321-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:49:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:49:50.465-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:49:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:50:20.882-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:50:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:50:51.156-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:50:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:51:21.513-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:51:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:51:51.693-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:51:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:52:21.987-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:52:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:52:52.336-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:52:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:53:22.600-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:53:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:53:32.073-0500 [conn1636] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T02:53:52.927-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:53:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:54:23.116-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:54:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:54:53.447-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:54:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:55:23.654-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:55:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:55:53.939-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:55:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:56:24.115-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:56:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:56:54.405-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:56:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:57:24.687-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:57:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:57:54.973-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:57:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:58:25.118-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:58:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:58:32.278-0500 [conn1637] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T02:58:55.404-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:58:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:59:25.713-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:59:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T02:59:55.904-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 02:59:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:00:26.050-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:00:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:00:56.363-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:00:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:01:26.692-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:01:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:01:56.851-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:01:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:02:27.192-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:02:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:02:57.558-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:02:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:03:27.871-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:03:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:03:32.298-0500 [conn1638] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T03:03:58.082-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:03:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:04:28.316-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:04:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:04:58.508-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:04:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:05:28.660-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:05:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:05:58.994-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:05:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:06:29.200-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:06:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:06:59.471-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:06:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:07:29.626-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:07:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:07:59.790-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:07:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:08:30.074-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:08:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:08:32.258-0500 [conn1639] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T03:09:00.429-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:09:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:09:30.688-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:09:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:10:01.023-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:10:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:10:31.169-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:10:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:11:01.544-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:11:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:11:31.849-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:11:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:12:02.136-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:12:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:12:32.423-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:12:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:13:02.768-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:13:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:13:32.242-0500 [conn1640] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T03:13:32.925-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:13:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:14:03.192-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:14:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:14:33.462-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:14:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:15:03.731-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:15:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:15:34.055-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:15:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:16:04.323-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:16:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:16:34.464-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:16:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:17:04.779-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:17:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:17:35.040-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:17:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:18:05.311-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:18:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:18:32.297-0500 [conn1641] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T03:18:35.572-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:18:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:19:05.835-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:19:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:19:36.193-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:19:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:20:06.445-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:20:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:20:36.633-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:20:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:21:06.809-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:21:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:21:37.093-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:21:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:22:07.361-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:22:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:22:37.633-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:22:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:23:07.914-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:23:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:23:32.289-0500 [conn1642] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T03:23:38.176-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:23:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:24:08.475-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:24:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:24:38.753-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:24:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:25:09.060-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:25:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:25:39.260-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:25:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:26:09.621-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:26:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:26:40.081-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:26:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:27:10.305-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:27:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:27:40.615-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:27:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:28:10.770-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:28:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:28:32.305-0500 [conn1643] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T03:28:41.078-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:28:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:29:11.272-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:29:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:29:41.550-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:29:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:30:11.706-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:30:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:30:41.977-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:30:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:31:12.179-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:31:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:31:42.364-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:31:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:32:12.533-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:32:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:32:42.841-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:32:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:33:13.041-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:33:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:33:32.289-0500 [conn1644] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T03:33:43.343-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:33:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:34:13.507-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:34:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:34:43.765-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:34:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:35:13.972-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:35:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:35:44.205-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:35:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:36:14.416-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:36:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:36:44.856-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:36:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:37:15.142-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:37:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:37:45.431-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:37:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:38:15.712-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:38:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:38:32.188-0500 [conn1645] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T03:38:45.989-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:38:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:39:16.256-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:39:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:39:46.535-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:39:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:40:16.808-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:40:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:40:47.050-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:40:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:41:17.318-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:41:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:41:47.621-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:41:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:42:17.832-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:42:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:42:48.023-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:42:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:43:18.299-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:43:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:43:32.080-0500 [conn1646] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T03:43:48.436-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:43:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:44:18.707-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:44:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:44:48.985-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:44:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:45:19.278-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:45:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:45:49.432-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:45:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:46:19.722-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:46:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:46:50.069-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:46:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:47:20.294-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:47:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:47:50.471-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:47:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:48:20.748-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:48:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:48:32.311-0500 [conn1647] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T03:48:50.968-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:48:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:49:21.241-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:49:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:49:51.516-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:49:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:50:21.655-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:50:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:50:51.947-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:50:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:51:22.104-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:51:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:51:52.338-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:51:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:52:22.592-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:52:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:52:52.883-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:52:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:53:23.284-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:53:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:53:32.203-0500 [conn1648] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T03:53:53.452-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:53:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:54:23.722-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:54:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:54:54.053-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:54:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:55:24.188-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:55:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:55:54.584-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:55:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:56:24.883-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:56:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:56:55.204-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:56:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:57:25.399-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:57:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:57:55.695-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:57:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:58:26.074-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:58:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:58:32.116-0500 [conn1649] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T03:58:56.399-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:58:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:59:26.673-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:59:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T03:59:56.931-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 03:59:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:00:27.219-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:00:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:00:57.610-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:00:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:01:27.821-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:01:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:01:58.102-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:01:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:02:28.447-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:02:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:02:58.743-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:02:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:03:29.053-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:03:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:03:32.385-0500 [conn1650] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T04:03:59.331-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:03:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:04:29.593-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:04:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:04:59.965-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:04:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:05:30.249-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:05:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:06:00.490-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:06:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:06:30.648-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:06:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:07:00.832-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:07:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:07:31.324-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:07:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:08:01.511-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:08:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:08:31.850-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:08:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:08:32.121-0500 [conn1651] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T04:09:02.216-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:09:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:09:32.800-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:09:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:10:03.157-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:10:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:10:33.391-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:10:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:11:03.555-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:11:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:11:33.943-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:11:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:12:04.390-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:12:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:12:34.560-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:12:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:13:04.823-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:13:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:13:32.120-0500 [conn1652] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T04:13:35.096-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:13:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:14:05.404-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:14:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:14:35.781-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:14:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:15:06.066-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:15:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:15:36.333-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:15:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:16:06.605-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:16:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:16:36.929-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:16:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:17:07.280-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:17:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:17:37.582-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:17:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:18:07.835-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:18:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:18:32.383-0500 [conn1653] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T04:18:38.084-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:18:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:19:08.330-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:19:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:19:38.625-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:19:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:20:08.967-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:20:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:20:39.219-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:20:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:21:09.494-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:21:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:21:39.731-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:21:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:22:10.004-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:22:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:22:40.246-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:22:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:23:10.531-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:23:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:23:32.471-0500 [conn1654] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T04:23:40.822-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:23:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:24:11.073-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:24:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:24:41.335-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:24:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:25:11.613-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:25:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:25:41.876-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:25:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:26:12.155-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:26:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:26:42.393-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:26:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:27:12.684-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:27:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:27:42.955-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:27:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:28:13.234-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:28:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:28:32.248-0500 [conn1655] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T04:28:43.500-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:28:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:29:13.884-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:29:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:29:44.155-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:29:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:30:14.547-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:30:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:30:44.851-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:30:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:31:15.060-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:31:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:31:45.289-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:31:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:32:15.598-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:32:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:32:45.885-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:32:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:33:16.104-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:33:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:33:32.185-0500 [conn1656] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T04:33:46.315-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:33:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:34:16.510-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:34:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:34:46.705-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:34:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:35:16.885-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:35:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:35:47.143-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:35:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:36:17.304-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:36:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:36:47.628-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:36:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:37:17.924-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:37:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:37:48.226-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:37:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:38:18.519-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:38:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:38:32.246-0500 [conn1657] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T04:38:48.719-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:38:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:39:19.064-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:39:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:39:49.328-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:39:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:40:19.625-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:40:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:40:49.926-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:40:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:41:20.081-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:41:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:41:50.531-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:41:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:42:20.793-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:42:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:42:50.960-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:42:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:43:21.244-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:43:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:43:32.105-0500 [conn1658] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T04:43:51.577-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:43:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:44:21.831-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:44:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:44:52.113-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:44:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:45:22.334-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:45:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:45:52.710-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:45:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:46:22.980-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:46:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:46:53.261-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:46:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:47:23.494-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:47:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:47:53.806-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:47:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:48:24.029-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:48:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:48:32.224-0500 [conn1659] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T04:48:54.431-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:48:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:49:24.625-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:49:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:49:54.898-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:49:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:50:25.173-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:50:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:50:55.454-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:50:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:51:25.740-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:51:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:51:56.028-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:51:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:52:26.176-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:52:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:52:56.583-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:52:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:53:26.724-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:53:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:53:32.347-0500 [conn1660] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T04:53:56.999-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:53:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:54:27.284-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:54:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:54:57.551-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:54:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:55:27.866-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:55:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:55:58.089-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:55:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:56:28.384-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:56:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:56:58.666-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:56:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:57:28.972-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:57:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:57:59.235-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:57:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:58:29.454-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:58:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:58:32.200-0500 [conn1661] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T04:58:59.726-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:58:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T04:59:30.000-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 04:59:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:00:00.177-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:00:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:00:30.373-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:00:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:01:00.654-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:01:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:01:30.824-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:01:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:02:01.094-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:02:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:02:31.391-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:02:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:03:01.811-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:03:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:03:32.107-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:03:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:03:32.274-0500 [conn1662] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T05:04:02.293-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:04:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:04:32.455-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:04:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:05:02.731-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:05:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:05:33.013-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:05:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:06:03.244-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:06:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:06:33.536-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:06:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:07:03.720-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:07:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:07:34.034-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:07:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:08:04.299-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:08:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:08:32.243-0500 [conn1663] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T05:08:34.608-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:08:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:09:04.906-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:09:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:09:35.180-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:09:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:10:05.453-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:10:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:10:35.775-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:10:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:11:05.922-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:11:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:11:36.193-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:11:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:12:06.415-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:12:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:12:36.596-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:12:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:13:06.863-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:13:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:13:32.172-0500 [conn1664] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T05:13:37.225-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:13:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:14:07.524-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:14:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:14:37.792-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:14:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:15:07.961-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:15:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:15:38.116-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:15:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:16:08.394-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:16:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:16:38.734-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:16:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:17:08.914-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:17:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:17:39.127-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:17:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:18:09.418-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:18:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:18:32.242-0500 [conn1665] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T05:18:39.597-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:18:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:19:09.828-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:19:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:19:40.058-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:19:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:20:10.358-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:20:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:20:40.557-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:20:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:21:10.786-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:21:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:21:41.037-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:21:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:22:11.413-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:22:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:22:41.669-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:22:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:23:12.027-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:23:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:23:32.203-0500 [conn1666] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T05:23:42.327-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:23:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:24:12.542-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:24:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:24:42.715-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:24:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:25:13.012-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:25:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:25:43.208-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:25:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:26:13.375-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:26:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:26:43.700-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:26:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:27:13.922-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:27:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:27:44.208-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:27:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:28:14.491-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:28:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:28:32.307-0500 [conn1667] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T05:28:44.787-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:28:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:29:15.084-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:29:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:29:45.354-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:29:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:30:15.618-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:30:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:30:45.932-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:30:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:31:16.342-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:31:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:31:46.607-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:31:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:32:16.878-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:32:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:32:47.247-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:32:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:33:17.495-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:33:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:33:32.237-0500 [conn1668] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T05:33:47.783-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:33:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:34:18.081-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:34:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:34:48.312-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:34:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:35:18.753-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:35:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:35:49.030-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:35:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:36:19.379-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:36:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:36:49.656-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:36:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:37:19.992-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:37:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:37:50.263-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:37:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:38:20.466-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:38:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:38:32.192-0500 [conn1669] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T05:38:50.757-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:38:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:39:20.932-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:39:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:39:51.224-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:39:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:40:21.511-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:40:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:40:51.794-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:40:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:41:22.061-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:41:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:41:52.344-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:41:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:42:22.480-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:42:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:42:52.781-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:42:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:43:23.064-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:43:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:43:32.158-0500 [conn1670] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T05:43:53.219-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:43:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:44:23.516-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:44:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:44:53.819-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:44:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:45:24.066-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:45:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:45:54.308-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:45:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:46:24.581-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:46:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:46:54.868-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:46:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:47:25.129-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:47:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:47:55.396-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:47:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:48:25.681-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:48:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:48:32.159-0500 [conn1671] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T05:48:55.929-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:48:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:49:26.226-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:49:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:49:56.371-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:49:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:50:26.642-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:50:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:50:57.005-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:50:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:51:27.277-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:51:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:51:57.697-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:51:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:52:27.962-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:52:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:52:58.257-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:52:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:53:28.689-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:53:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:53:32.324-0500 [conn1672] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T05:53:58.978-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:53:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:54:29.263-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:54:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:54:59.428-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:54:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:55:29.708-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:55:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:56:00.123-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:55:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:56:30.477-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:56:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:57:00.773-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:57:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:57:31.067-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:57:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:58:01.472-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:58:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:58:31.957-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:58:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:58:32.171-0500 [conn1673] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T05:59:02.228-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:59:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T05:59:32.486-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 05:59:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:00:02.772-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:00:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:00:33.084-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:00:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:01:03.277-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:01:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:01:33.569-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:01:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:02:03.835-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:02:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:02:34.109-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:02:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:03:04.337-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:03:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:03:32.122-0500 [conn1674] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T06:03:34.546-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:03:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:04:04.809-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:04:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:04:35.092-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:04:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:05:05.243-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:05:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:05:35.518-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:05:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:06:05.787-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:06:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:06:36.141-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:06:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:07:06.456-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:07:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:07:36.614-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:07:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:08:06.903-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:08:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:08:32.103-0500 [conn1675] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T06:08:37.414-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:08:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:09:07.706-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:09:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:09:37.886-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:09:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:10:08.168-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:10:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:10:38.442-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:10:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:11:08.709-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:11:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:11:39.031-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:11:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:12:09.316-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:12:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:12:39.497-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:12:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:13:09.757-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:13:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:13:32.272-0500 [conn1676] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T06:13:40.064-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:13:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:14:10.362-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:14:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:14:40.676-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:14:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:15:10.949-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:15:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:15:41.216-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:15:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:16:11.366-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:16:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:16:41.629-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:16:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:17:11.801-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:17:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:17:42.117-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:17:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:18:12.434-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:18:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:18:32.301-0500 [conn1677] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T06:18:42.795-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:18:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:19:13.038-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:19:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:19:43.305-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:19:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:20:13.627-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:20:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:20:43.808-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:20:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:21:14.055-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:21:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:21:44.436-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:21:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:22:14.742-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:22:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:22:44.933-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:22:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:23:15.216-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:23:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:23:32.200-0500 [conn1678] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T06:23:45.543-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:23:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:24:15.692-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:24:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:24:45.977-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:24:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:25:16.253-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:25:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:25:46.523-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:25:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:26:16.793-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:26:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:26:47.209-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:26:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:27:17.357-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:27:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:27:47.618-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:27:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:28:17.797-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:28:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:28:32.150-0500 [conn1679] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T06:28:48.140-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:28:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:29:18.427-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:29:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:29:48.712-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:29:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:30:18.852-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:30:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:30:48.992-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:30:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:31:19.187-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:31:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:31:49.457-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:31:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:32:19.600-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:32:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:32:49.947-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:32:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:33:20.284-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:33:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:33:32.137-0500 [conn1680] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T06:33:50.562-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:33:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:34:20.925-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:34:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:34:51.271-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:34:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:35:21.534-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:35:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:35:51.818-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:35:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:36:22.093-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:36:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:36:52.407-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:36:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:37:22.895-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:37:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:37:53.083-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:37:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:38:23.220-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:38:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:38:32.300-0500 [conn1681] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T06:38:53.368-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:38:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:39:23.522-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:39:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:39:53.811-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:39:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:40:23.981-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:40:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:40:54.260-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:40:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:41:24.533-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:41:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:41:54.692-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:41:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:42:24.986-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:42:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:42:55.147-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:42:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:43:25.464-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:43:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:43:32.146-0500 [conn1682] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T06:43:55.750-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:43:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:44:26.006-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:44:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:44:56.152-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:44:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:45:26.495-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:45:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:45:56.655-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:45:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:46:26.916-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:46:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:46:57.196-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:46:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:47:27.491-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:47:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:47:57.768-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:47:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:48:27.915-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:48:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:48:32.183-0500 [conn1683] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T06:48:58.099-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:48:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:49:28.338-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:49:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:49:58.675-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:49:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:50:28.951-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:50:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:50:59.246-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:50:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:51:29.506-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:51:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:51:59.790-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:51:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:52:30.082-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:52:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:53:00.342-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:53:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:53:30.706-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:53:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:53:32.335-0500 [conn1684] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T06:54:00.986-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:54:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:54:31.167-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:54:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:55:01.450-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:55:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:55:31.588-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:55:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:56:01.859-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:56:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:56:32.112-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:56:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:57:02.381-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:57:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:57:32.634-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:57:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:58:02.917-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:58:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:58:32.305-0500 [conn1685] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T06:58:33.135-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:58:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:59:03.415-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:59:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T06:59:33.740-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 06:59:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:00:04.040-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:00:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:00:34.347-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:00:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:01:04.735-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:01:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:01:34.945-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:01:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:02:05.219-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:02:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:02:35.472-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:02:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:03:05.704-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:03:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:03:32.133-0500 [conn1686] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T07:03:36.046-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:03:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:04:06.231-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:04:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:04:36.497-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:04:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:05:06.833-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:05:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:05:37.154-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:05:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:06:07.316-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:06:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:06:37.623-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:06:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:07:07.911-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:07:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:07:38.185-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:07:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:08:08.518-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:08:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:08:32.122-0500 [conn1687] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T07:08:38.909-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:08:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:09:09.185-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:09:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:09:39.432-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:09:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:10:09.689-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:10:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:10:40.004-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:10:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:11:10.186-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:11:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:11:40.473-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:11:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:12:10.865-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:12:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:12:41.148-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:12:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:13:11.352-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:13:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:13:32.270-0500 [conn1688] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T07:13:41.487-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:13:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:14:11.745-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:14:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:14:42.004-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:14:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:15:12.298-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:15:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:15:42.691-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:15:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:16:12.964-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:16:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:16:43.222-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:16:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:17:13.508-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:17:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:17:43.783-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:17:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:18:14.099-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:18:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:18:32.126-0500 [conn1689] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T07:18:44.318-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:18:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:19:14.637-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:19:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:19:44.846-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:19:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:20:15.112-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:20:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:20:45.313-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:20:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:21:15.592-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:21:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:21:45.823-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:21:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:22:16.127-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:22:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:22:46.422-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:22:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:23:16.705-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:23:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:23:32.151-0500 [conn1690] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T07:23:46.981-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:23:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:24:17.273-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:24:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:24:47.705-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:24:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:25:17.972-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:25:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:25:48.266-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:25:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:26:18.465-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:26:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:26:48.718-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:26:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:27:18.984-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:27:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:27:49.238-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:27:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:28:19.520-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:28:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:28:32.264-0500 [conn1691] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T07:28:49.793-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:28:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:29:19.932-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:29:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:29:50.132-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:29:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:30:20.394-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:30:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:30:50.729-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:30:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:31:20.996-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:31:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:31:51.404-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:31:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:32:21.595-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:32:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:32:51.859-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:32:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:33:22.010-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:33:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:33:32.117-0500 [conn1692] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T07:33:52.306-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:33:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:34:22.607-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:34:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:34:53.025-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:34:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:35:23.168-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:35:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:35:53.427-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:35:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:36:23.641-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:36:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:36:53.869-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:36:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:37:24.141-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:37:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:37:54.446-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:37:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:38:24.719-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:38:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:38:32.098-0500 [conn1693] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T07:38:54.911-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:38:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:39:25.042-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:39:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:39:55.294-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:39:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:40:25.559-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:40:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:40:55.828-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:40:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:41:26.026-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:41:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:41:56.230-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:41:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:42:26.514-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:42:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:42:56.823-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:42:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:43:27.124-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:43:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:43:32.103-0500 [conn1694] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T07:43:57.367-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:43:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:44:27.613-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:44:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:44:57.749-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:44:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:45:28.008-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:45:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:45:58.159-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:45:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:46:28.364-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:46:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:46:58.619-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:46:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:47:28.893-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:47:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:47:59.054-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:47:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:48:29.329-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:48:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:48:32.228-0500 [conn1695] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T07:48:59.478-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:48:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:49:29.644-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:49:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:50:00.070-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:49:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:50:30.348-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:50:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:51:00.613-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:51:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:51:30.902-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:51:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:52:01.167-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:52:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:52:31.580-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:52:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:53:01.858-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:53:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:53:32.154-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:53:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:53:32.204-0500 [conn1696] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T07:54:02.374-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:54:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:54:32.712-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:54:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:55:03.018-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:55:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:55:33.312-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:55:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:56:03.450-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:56:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:56:33.693-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:56:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:57:03.979-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:57:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:57:34.274-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:57:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:58:04.529-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:58:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:58:32.250-0500 [conn1697] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T07:58:34.794-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:58:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:59:05.002-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:59:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T07:59:35.149-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 07:59:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:00:05.424-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:00:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:00:35.689-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:00:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:01:05.956-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:01:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:01:36.219-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:01:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:02:06.472-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:02:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:02:36.738-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:02:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:03:07.115-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:03:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:03:32.326-0500 [conn1698] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T08:03:37.404-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:03:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:04:07.662-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:04:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:04:37.927-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:04:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:05:08.206-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:05:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:05:38.399-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:05:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:06:08.680-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:06:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:06:38.958-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:06:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:07:09.098-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:07:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:07:39.370-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:07:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:08:09.642-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:08:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:08:32.287-0500 [conn1699] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T08:08:39.869-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:08:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:09:10.132-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:09:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:09:40.293-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:09:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:10:10.592-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:10:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:10:40.864-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:10:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:11:11.005-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:11:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:11:41.325-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:11:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:12:11.617-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:12:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:12:41.988-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:12:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:13:12.351-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:13:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:13:32.336-0500 [conn1700] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T08:13:42.634-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:13:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:14:12.775-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:14:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:14:43.030-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:14:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:15:13.209-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:15:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:15:43.422-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:15:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:16:13.752-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:16:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:16:43.895-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:16:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:17:14.200-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:17:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:17:44.391-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:17:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:18:14.686-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:18:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:18:32.193-0500 [conn1701] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T08:18:44.884-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:18:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:19:15.256-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:19:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:19:45.534-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:19:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:20:15.812-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:20:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:20:46.077-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:20:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:21:16.362-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:21:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:21:46.587-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:21:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:22:16.861-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:22:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:22:47.011-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:22:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:23:17.285-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:23:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:23:32.273-0500 [conn1702] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T08:23:47.522-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:23:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:24:18.007-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:24:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:24:48.354-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:24:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:25:18.648-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:25:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:25:48.930-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:25:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:26:19.108-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:26:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:26:49.377-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:26:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:27:19.697-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:27:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:27:49.971-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:27:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:28:20.242-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:28:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:28:32.335-0500 [conn1703] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T08:28:50.611-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:28:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:29:20.915-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:29:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:29:51.288-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:29:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:30:21.580-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:30:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:30:51.949-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:30:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:31:22.222-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:31:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:31:52.386-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:31:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:32:22.669-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:32:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:32:52.851-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:32:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:33:23.140-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:33:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:33:32.331-0500 [conn1704] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T08:33:53.343-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:33:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:34:23.640-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:34:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:34:53.911-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:34:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:35:24.185-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:35:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:35:54.473-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:35:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:36:24.764-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:36:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:36:54.950-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:36:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:37:25.291-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:37:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:37:55.624-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:37:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:38:25.919-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:38:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:38:32.211-0500 [conn1705] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T08:38:56.190-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:38:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:39:26.456-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:39:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:39:56.663-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:39:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:40:26.931-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:40:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:40:57.200-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:40:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:41:27.519-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:41:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:41:57.760-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:41:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:42:28.043-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:42:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:42:58.292-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:42:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:43:28.570-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:43:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:43:32.109-0500 [conn1706] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T08:43:58.822-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:43:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:44:29.088-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:44:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:44:59.356-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:44:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:45:29.769-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:45:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:46:00.185-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:45:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:46:30.324-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:46:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:47:00.577-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:47:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:47:30.881-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:47:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:48:01.082-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:48:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:48:31.347-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:48:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:48:32.372-0500 [conn1707] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T08:49:01.516-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:49:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:49:31.814-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:49:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:50:02.184-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:50:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:50:32.461-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:50:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:51:02.815-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:51:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:51:33.095-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:51:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:52:03.329-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:52:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:52:33.769-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:52:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:53:04.035-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:53:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:53:32.177-0500 [conn1708] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T08:53:34.208-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:53:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:54:04.411-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:54:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:54:34.647-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:54:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:55:04.807-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:55:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:55:35.200-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:55:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:56:05.497-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:56:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:56:35.679-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:56:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:57:06.027-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:57:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:57:36.296-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:57:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:58:06.702-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:58:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:58:32.109-0500 [conn1709] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T08:58:37.001-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:58:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:59:07.291-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:59:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T08:59:37.556-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 08:59:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:00:07.830-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:00:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:00:38.130-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:00:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:01:08.472-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:01:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:01:38.764-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:01:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:02:09.122-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:02:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:02:39.383-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:02:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:03:09.861-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:03:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:03:32.128-0500 [conn1710] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T09:03:40.179-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:03:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:04:10.529-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:04:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:04:40.803-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:04:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:05:11.151-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:05:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:05:41.541-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:05:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:06:11.776-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:06:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:06:42.230-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:06:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:07:12.537-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:07:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:07:42.891-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:07:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:08:13.229-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:08:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:08:32.167-0500 [conn1711] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T09:08:43.560-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:08:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:09:13.974-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:09:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:09:44.374-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:09:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:10:14.581-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:10:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:10:44.891-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:10:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:11:15.198-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:11:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:11:45.531-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:11:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:12:15.796-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:12:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:12:46.086-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:12:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:13:16.339-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:13:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:13:32.192-0500 [conn1712] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T09:13:46.682-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:13:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:14:17.000-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:14:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:14:47.216-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:14:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:15:17.572-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:15:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:15:47.859-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:15:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:16:18.065-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:16:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:16:48.391-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:16:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:17:18.618-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:17:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:17:48.889-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:17:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:18:19.171-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:18:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:18:32.397-0500 [conn1713] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T09:18:49.468-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:18:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:19:19.642-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:19:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:19:49.933-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:19:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:20:20.227-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:20:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:20:50.497-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:20:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:21:20.817-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:21:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:21:51.170-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:21:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:22:21.430-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:22:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:22:51.740-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:22:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:23:22.182-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:23:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:23:32.276-0500 [conn1714] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T09:23:52.404-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:23:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:24:22.693-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:24:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:24:52.958-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:24:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:25:23.248-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:25:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:25:53.414-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:25:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:26:23.724-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:26:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:26:54.107-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:26:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:27:24.398-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:27:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:27:54.701-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:27:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:28:24.904-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:28:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:28:32.230-0500 [conn1715] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T09:28:55.227-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:28:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:29:25.411-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:29:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:29:55.609-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:29:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:30:25.871-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:30:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:30:56.058-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:30:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:31:26.234-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:31:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:31:56.611-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:31:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:32:26.940-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:32:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:32:57.192-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:32:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:33:27.464-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:33:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:33:32.099-0500 [conn1716] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T09:33:57.744-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:33:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:34:28.017-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:34:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:34:58.334-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:34:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:35:28.511-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:35:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:35:58.794-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:35:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:36:29.119-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:36:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:36:59.412-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:36:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:37:29.842-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:37:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:38:00.083-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:37:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:38:30.410-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:38:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:38:32.308-0500 [conn1717] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T09:39:00.777-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:39:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:39:31.124-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:39:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:40:01.397-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:40:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:40:31.783-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:40:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:41:02.085-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:41:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:41:32.514-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:41:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:42:02.870-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:42:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:42:33.185-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:42:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:43:03.623-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:43:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:43:32.228-0500 [conn1718] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T09:43:33.981-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:43:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:44:04.285-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:44:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:44:34.633-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:44:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:45:04.945-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:45:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:45:35.390-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:45:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:46:05.627-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:46:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:46:36.047-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:46:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:47:06.352-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:47:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:47:36.601-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:47:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:48:06.916-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:48:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:48:32.254-0500 [conn1719] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T09:48:37.212-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:48:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:49:07.452-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:49:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:49:37.695-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:49:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:50:08.034-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:50:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:50:38.269-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:50:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:51:08.555-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:51:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:51:38.828-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:51:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:52:09.107-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:52:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:52:39.555-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:52:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:53:09.788-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:53:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:53:32.193-0500 [conn1720] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T09:53:40.062-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:53:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:54:10.365-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:54:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:54:40.643-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:54:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:55:10.930-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:55:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:55:41.238-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:55:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:56:11.555-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:56:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:56:41.880-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:56:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:57:12.194-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:57:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:57:42.403-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:57:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:58:12.549-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:58:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:58:32.330-0500 [conn1721] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T09:58:42.933-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:58:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:59:13.720-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:59:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T09:59:43.976-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 09:59:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:00:14.202-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:00:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:00:44.506-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:00:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:01:14.760-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:01:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:01:45.056-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:01:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:02:15.298-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:02:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:02:45.693-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:02:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:03:15.933-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:03:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:03:32.147-0500 [conn1722] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T10:03:46.160-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:03:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:04:16.436-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:04:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:04:46.697-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:04:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:05:16.958-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:05:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:05:47.103-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:05:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:06:17.391-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:06:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:06:47.531-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:06:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:07:17.804-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:07:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:07:48.051-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:07:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:08:18.469-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:08:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:08:32.292-0500 [conn1723] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T10:08:48.847-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:08:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:09:19.132-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:09:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:09:49.448-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:09:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:10:19.741-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:10:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:10:50.090-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:10:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:11:20.468-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:11:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:11:50.783-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:11:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:12:20.995-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:12:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:12:51.261-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:12:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:13:21.599-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:13:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:13:32.273-0500 [conn1724] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T10:13:51.942-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:13:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:14:22.267-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:14:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:14:52.609-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:14:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:15:22.855-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:15:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:15:53.231-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:15:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:16:23.493-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:16:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:16:53.705-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:16:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:17:23.965-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:17:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:17:54.240-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:17:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:18:24.467-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:18:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:18:32.198-0500 [conn1725] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T10:18:54.730-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:18:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:19:25.030-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:19:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:19:55.424-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:19:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:20:25.649-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:20:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:20:55.823-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:20:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:21:26.098-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:21:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:21:56.399-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:21:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:22:26.675-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:22:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:22:56.952-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:22:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:23:27.177-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:23:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:23:32.106-0500 [conn1726] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T10:23:57.449-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:23:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:24:27.680-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:24:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:24:57.954-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:24:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:25:28.231-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:25:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:25:58.569-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:25:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:26:28.796-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:26:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:26:59.147-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:26:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:27:29.615-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:27:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:27:59.895-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:27:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:28:30.184-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:28:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:28:32.135-0500 [conn1727] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T10:29:00.439-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:29:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:29:30.734-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:29:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:30:00.965-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:30:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:30:31.120-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:30:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:31:01.401-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:31:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:31:31.589-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:31:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:32:01.836-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:32:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:32:32.123-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:32:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:33:02.320-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:33:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:33:32.271-0500 [conn1728] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T10:33:32.683-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:33:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:34:03.007-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:34:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:34:33.452-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:34:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:35:03.741-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:35:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:35:33.946-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:35:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:36:04.188-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:36:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:36:34.606-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:36:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:37:04.875-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:37:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:37:35.184-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:37:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:38:05.691-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:38:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:38:32.200-0500 [conn1729] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T10:38:35.989-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:38:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:39:06.319-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:39:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:39:36.654-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:39:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:40:06.953-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:40:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:40:37.204-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:40:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:41:07.487-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:41:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:41:37.713-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:41:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:42:07.948-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:42:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:42:38.218-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:42:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:43:08.724-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:43:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:43:32.221-0500 [conn1730] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T10:43:38.991-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:43:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:44:09.180-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:44:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:44:39.548-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:44:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:45:09.699-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:45:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:45:39.956-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:45:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:46:10.227-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:46:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:46:40.554-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:46:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:47:10.813-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:47:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:47:41.124-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:47:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:48:11.320-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:48:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:48:32.288-0500 [conn1731] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T10:48:41.610-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:48:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:49:11.841-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:49:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:49:42.148-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:49:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:50:12.483-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:50:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:50:42.707-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:50:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:51:12.969-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:51:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:51:43.244-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:51:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:52:13.517-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:52:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:52:43.793-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:52:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:53:14.079-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:53:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:53:32.216-0500 [conn1732] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T10:53:44.361-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:53:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:54:14.690-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:54:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:54:44.851-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:54:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:55:15.130-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:55:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:55:45.271-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:55:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:56:15.476-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:56:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:56:45.772-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:56:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:57:16.012-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:57:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:57:46.360-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:57:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:58:16.538-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:58:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:58:32.325-0500 [conn1733] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T10:58:46.812-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:58:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:59:17.612-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:59:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T10:59:47.960-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 10:59:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:00:18.179-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:00:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:00:48.491-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:00:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:01:18.820-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:01:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:01:49.223-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:01:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:02:19.529-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:02:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:02:49.846-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:02:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:03:20.177-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:03:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:03:32.145-0500 [conn1734] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T11:03:50.346-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:03:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:04:20.567-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:04:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:04:50.903-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:04:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:05:21.085-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:05:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:05:51.339-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:05:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:06:21.650-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:06:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:06:51.894-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:06:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:07:22.204-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:07:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:07:52.555-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:07:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:08:22.918-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:08:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:08:32.143-0500 [conn1735] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T11:08:53.187-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:08:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:09:23.474-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:09:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:09:53.835-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:09:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:10:24.144-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:10:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:10:54.397-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:10:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:11:24.742-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:11:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:11:54.987-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:11:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:12:25.350-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:12:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:12:55.732-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:12:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:13:26.012-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:13:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:13:32.315-0500 [conn1736] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T11:13:56.294-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:13:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:14:26.538-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:14:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:14:56.888-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:14:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:15:27.195-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:15:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:15:57.444-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:15:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:16:27.716-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:16:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:16:58.035-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:16:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:17:28.319-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:17:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:17:58.463-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:17:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:18:28.756-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:18:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:18:32.134-0500 [conn1737] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T11:18:59.014-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:18:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:19:29.317-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:19:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:19:59.543-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:19:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:20:29.869-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:20:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:21:00.086-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:20:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:21:30.352-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:21:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:22:00.523-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:22:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:22:30.831-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:22:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:23:01.145-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:23:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:23:31.413-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:23:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:23:32.180-0500 [conn1738] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T11:24:01.692-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:24:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:24:31.983-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:24:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:25:02.318-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:25:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:25:32.470-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:25:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:26:02.812-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:26:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:26:33.119-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:26:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:27:03.347-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:27:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:27:33.715-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:27:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:28:03.917-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:28:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:28:32.144-0500 [conn1739] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T11:28:34.137-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:28:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:29:04.499-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:29:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:29:34.715-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:29:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:30:04.967-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:30:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:30:35.291-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:30:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:31:05.527-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:31:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:31:35.815-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:31:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:32:06.078-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:32:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:32:36.259-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:32:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:33:06.513-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:33:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:33:32.244-0500 [conn1740] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T11:33:36.801-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:33:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:34:07.026-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:34:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:34:37.253-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:34:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:35:07.576-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:35:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:35:37.876-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:35:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:36:08.253-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:36:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:36:38.499-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:36:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:37:08.843-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:37:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:37:38.994-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:37:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:38:09.264-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:38:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:38:32.089-0500 [conn1741] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T11:38:39.651-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:38:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:39:09.943-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:39:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:39:40.230-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:39:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:40:10.500-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:40:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:40:40.793-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:40:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:41:11.115-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:41:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:41:41.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:41:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:42:11.618-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:42:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:42:41.890-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:42:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:43:12.194-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:43:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:43:32.248-0500 [conn1742] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T11:43:42.456-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:43:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:44:12.724-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:44:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:44:42.960-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:44:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:45:13.123-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:45:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:45:43.413-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:45:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:46:13.653-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:46:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:46:44.037-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:46:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:47:14.343-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:47:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:47:44.557-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:47:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:48:14.851-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:48:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:48:32.406-0500 [conn1743] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T11:48:45.146-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:48:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:49:15.518-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:49:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:49:45.899-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:49:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:50:16.196-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:50:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:50:46.349-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:50:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:51:16.536-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:51:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:51:46.825-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:51:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:52:17.140-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:52:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:52:47.302-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:52:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:53:17.580-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:53:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:53:32.137-0500 [conn1744] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T11:53:47.760-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:53:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:54:18.102-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:54:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:54:48.322-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:54:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:55:18.619-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:55:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:55:48.845-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:55:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:56:19.186-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:56:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:56:49.397-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:56:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:57:19.654-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:57:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:57:49.805-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:57:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:58:20.096-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:58:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:58:32.127-0500 [conn1745] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T11:58:50.268-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:58:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:59:20.707-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:59:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T11:59:51.036-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 11:59:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:00:21.232-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:00:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:00:51.386-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:00:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:01:21.656-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:01:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:01:52.025-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:01:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:02:22.231-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:02:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:02:52.511-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:02:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:03:22.751-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:03:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:03:32.278-0500 [conn1746] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T12:03:53.063-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:03:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:04:23.377-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:04:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:04:53.682-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:04:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:05:24.017-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:05:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:05:54.294-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:05:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:06:24.601-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:06:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:06:54.868-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:06:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:07:25.148-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:07:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:07:55.517-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:07:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:08:25.775-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:08:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:08:32.303-0500 [conn1747] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T12:08:56.007-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:08:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:09:26.278-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:09:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:09:56.450-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:09:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:10:26.613-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:10:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:10:56.898-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:10:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:11:27.130-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:11:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:11:57.291-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:11:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:12:27.665-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:12:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:12:57.878-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:12:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:13:28.166-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:13:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:13:32.304-0500 [conn1748] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T12:13:58.420-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:13:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:14:28.603-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:14:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:14:58.901-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:14:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:15:29.227-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:15:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:15:59.523-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:15:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:16:29.811-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:16:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:17:00.129-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:16:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:17:30.492-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:17:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:18:00.984-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:18:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:18:31.131-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:18:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:18:32.138-0500 [conn1749] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T12:19:01.397-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:19:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:19:31.673-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:19:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:20:01.924-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:20:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:20:32.209-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:20:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:21:02.470-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:21:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:21:32.740-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:21:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:22:03.099-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:22:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:22:33.457-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:22:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:23:03.606-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:23:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:23:32.178-0500 [conn1750] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T12:23:33.830-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:23:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:24:04.120-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:24:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:24:34.451-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:24:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:25:04.841-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:25:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:25:34.979-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:25:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:26:05.373-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:26:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:26:35.708-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:26:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:27:05.972-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:27:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:27:36.270-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:27:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:28:06.537-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:28:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:28:32.293-0500 [conn1751] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T12:28:36.835-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:28:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:29:06.965-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:29:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:29:37.258-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:29:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:30:07.643-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:30:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:30:38.001-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:30:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:31:08.199-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:31:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:31:38.602-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:31:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:32:08.941-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:32:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:32:39.229-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:32:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:33:09.385-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:33:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:33:32.309-0500 [conn1752] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T12:33:39.670-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:33:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:34:09.967-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:34:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:34:40.243-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:34:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:35:10.527-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:35:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:35:40.737-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:35:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:36:11.018-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:36:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:36:41.318-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:36:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:37:11.651-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:37:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:37:41.904-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:37:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:38:12.140-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:38:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:38:32.199-0500 [conn1753] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T12:38:42.409-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:38:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:39:12.685-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:39:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:39:42.954-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:39:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:40:13.300-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:40:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:40:43.581-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:40:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:41:13.889-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:41:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:41:44.189-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:41:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:42:14.324-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:42:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:42:44.665-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:42:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:43:15.033-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:43:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:43:32.318-0500 [conn1754] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T12:43:45.305-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:43:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:44:15.650-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:44:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:44:45.826-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:44:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:45:16.129-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:45:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:45:46.339-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:45:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:46:16.620-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:46:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:46:46.905-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:46:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:47:17.122-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:47:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:47:47.339-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:47:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:48:17.507-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:48:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:48:32.301-0500 [conn1755] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T12:48:47.798-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:48:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:49:18.004-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:49:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:49:48.288-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:49:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:50:18.433-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:50:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:50:48.708-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:50:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:51:18.965-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:51:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:51:49.112-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:51:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:52:19.359-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:52:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:52:49.497-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:52:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:53:19.774-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:53:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:53:32.347-0500 [conn1756] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T12:53:50.213-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:53:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:54:20.614-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:54:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:54:50.902-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:54:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:55:21.178-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:55:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:55:51.350-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:55:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:56:21.523-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:56:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:56:51.665-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:56:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:57:21.825-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:57:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:57:52.103-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:57:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:58:22.497-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:58:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:58:32.341-0500 [conn1757] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T12:58:52.711-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:58:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:59:23.008-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:59:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T12:59:53.163-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 12:59:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:00:23.447-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:00:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:00:53.692-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:00:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:01:23.903-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:01:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:01:54.167-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:01:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:02:24.425-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:02:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:02:54.625-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:02:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:03:24.892-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:03:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:03:32.149-0500 [conn1758] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T13:03:55.022-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:03:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:04:25.182-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:04:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:04:55.342-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:04:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:05:25.532-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:05:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:05:55.805-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:05:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:06:26.022-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:06:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:06:56.328-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:06:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:07:26.689-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:07:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:07:56.860-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:07:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:08:27.161-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:08:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:08:32.269-0500 [conn1759] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T13:08:57.451-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:08:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:09:27.898-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:09:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:09:58.263-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:09:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:10:28.606-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:10:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:10:58.751-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:10:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:11:29.000-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:11:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:11:59.448-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:11:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:12:29.635-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:12:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:12:59.946-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:12:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:13:30.261-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:13:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:13:32.342-0500 [conn1760] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T13:14:00.505-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:14:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:14:30.711-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:14:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:15:01.053-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:15:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:15:31.248-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:15:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:16:01.520-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:16:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:16:31.808-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:16:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:17:02.063-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:17:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:17:32.470-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:17:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:18:02.756-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:18:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:18:32.256-0500 [conn1761] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T13:18:33.027-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:18:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:19:03.310-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:19:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:19:33.601-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:19:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:20:03.878-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:20:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:20:34.073-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:20:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:21:04.350-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:21:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:21:34.640-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:21:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:22:04.905-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:22:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:22:35.178-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:22:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:23:05.473-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:23:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:23:32.323-0500 [conn1762] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T13:23:35.635-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:23:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:24:05.831-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:24:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:24:36.091-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:24:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:25:06.420-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:25:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:25:36.652-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:25:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:26:06.932-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:26:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:26:37.158-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:26:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:27:07.620-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:27:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:27:37.823-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:27:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:28:07.988-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:28:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:28:32.118-0500 [conn1763] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T13:28:38.172-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:28:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:29:08.539-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:29:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:29:38.819-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:29:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:30:09.085-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:30:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:30:39.492-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:30:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:31:09.945-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:31:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:31:40.186-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:31:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:32:10.412-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:32:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:32:40.806-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:32:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:33:11.124-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:33:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:33:32.326-0500 [conn1764] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T13:33:41.480-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:33:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:34:11.758-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:34:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:34:42.092-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:34:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:35:12.347-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:35:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:35:42.549-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:35:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:36:12.710-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:36:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:36:43.053-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:36:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:37:13.262-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:37:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:37:43.550-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:37:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:38:13.812-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:38:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:38:32.307-0500 [conn1765] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T13:38:44.110-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:38:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:39:14.323-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:39:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:39:44.612-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:39:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:40:14.921-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:40:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:40:45.073-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:40:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:41:15.222-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:41:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:41:45.505-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:41:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:42:15.749-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:42:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:42:45.948-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:42:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:43:16.241-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:43:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:43:32.160-0500 [conn1766] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T13:43:46.514-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:43:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:44:16.806-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:44:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:44:47.101-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:44:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:45:17.321-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:45:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:45:47.574-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:45:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:46:17.824-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:46:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:46:48.120-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:46:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:47:18.496-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:47:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:47:48.880-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:47:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:48:19.148-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:48:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:48:32.170-0500 [conn1767] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T13:48:49.520-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:48:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:49:19.867-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:49:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:49:50.197-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:49:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:50:20.434-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:50:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:50:50.704-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:50:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:51:20.967-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:51:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:51:51.187-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:51:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:52:21.498-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:52:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:52:51.774-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:52:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:53:22.147-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:53:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:53:32.281-0500 [conn1768] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T13:53:52.427-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:53:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:54:22.743-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:54:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:54:53.030-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:54:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:55:23.295-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:55:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:55:53.579-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:55:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:56:23.894-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:56:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:56:54.167-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:56:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:57:24.458-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:57:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:57:54.814-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:57:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:58:25.086-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:58:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:58:32.214-0500 [conn1769] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T13:58:55.403-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:58:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:59:25.701-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:59:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T13:59:55.984-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 13:59:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:00:26.299-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:00:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:00:56.486-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:00:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:01:26.741-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:01:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:01:56.880-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:01:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:02:27.269-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:02:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:02:57.431-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:02:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:03:27.656-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:03:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:03:32.131-0500 [conn1770] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T14:03:57.937-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:03:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:04:28.081-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:04:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:04:58.307-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:04:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:05:28.627-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:05:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:05:58.903-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:05:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:06:29.133-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:06:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:06:59.396-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:06:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:07:29.674-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:07:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:08:00.000-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:07:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:08:30.265-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:08:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:08:32.314-0500 [conn1771] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T14:09:00.542-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:09:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:09:30.832-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:09:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:10:01.134-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:10:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:10:31.587-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:10:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:11:01.774-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:11:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:11:31.959-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:11:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:12:02.160-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:12:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:12:32.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:12:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:13:02.724-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:13:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:13:32.161-0500 [conn1772] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T14:13:33.007-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:13:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:14:03.207-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:14:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:14:33.479-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:14:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:15:03.924-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:15:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:15:34.219-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:15:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:16:04.503-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:16:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:16:34.722-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:16:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:17:05.046-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:17:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:17:35.248-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:17:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:18:05.552-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:18:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:18:32.210-0500 [conn1773] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T14:18:35.690-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:18:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:19:05.974-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:19:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:19:36.294-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:19:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:20:06.619-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:20:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:20:36.817-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:20:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:21:07.122-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:21:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:21:37.385-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:21:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:22:07.560-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:22:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:22:37.862-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:22:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:23:08.148-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:23:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:23:32.125-0500 [conn1774] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T14:23:38.427-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:23:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:24:08.706-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:24:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:24:39.061-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:24:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:25:09.329-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:25:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:25:39.678-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:25:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:26:09.957-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:26:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:26:40.249-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:26:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:27:10.457-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:27:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:27:40.642-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:27:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:28:10.798-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:28:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:28:32.325-0500 [conn1775] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T14:28:41.053-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:28:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:29:11.260-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:29:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:29:41.415-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:29:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:30:11.669-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:30:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:30:41.957-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:30:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:31:12.210-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:31:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:31:42.518-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:31:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:32:12.773-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:32:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:32:42.980-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:32:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:33:13.174-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:33:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:33:32.095-0500 [conn1776] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T14:33:43.443-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:33:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:34:13.699-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:34:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:34:44.040-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:34:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:35:14.406-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:35:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:35:44.693-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:35:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:36:14.952-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:36:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:36:45.225-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:36:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:37:15.498-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:37:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:37:45.765-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:37:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:38:15.943-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:38:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:38:32.304-0500 [conn1777] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T14:38:46.213-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:38:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:39:16.515-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:39:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:39:46.758-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:39:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:40:17.035-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:40:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:40:47.176-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:40:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:41:17.467-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:41:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:41:47.767-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:41:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:42:17.964-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:42:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:42:48.241-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:42:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:43:18.584-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:43:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:43:32.284-0500 [conn1778] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T14:43:48.911-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:43:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:44:19.163-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:44:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:44:49.429-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:44:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:45:19.565-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:45:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:45:49.839-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:45:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:46:20.229-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:46:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:46:50.427-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:46:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:47:20.727-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:47:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:47:50.968-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:47:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:48:21.131-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:48:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:48:32.209-0500 [conn1779] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T14:48:51.420-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:48:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:49:21.810-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:49:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:49:52.073-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:49:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:50:22.355-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:50:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:50:52.647-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:50:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:51:22.961-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:51:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:51:53.380-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:51:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:52:23.666-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:52:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:52:53.945-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:52:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:53:24.240-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:53:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:53:32.106-0500 [conn1780] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T14:53:54.535-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:53:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:54:24.846-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:54:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:54:55.089-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:54:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:55:25.376-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:55:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:55:55.658-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:55:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:56:25.934-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:56:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:56:56.436-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:56:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:57:26.710-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:57:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:57:56.969-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:57:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:58:27.320-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:58:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:58:32.291-0500 [conn1781] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T14:58:57.688-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:58:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:59:27.893-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:59:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T14:59:58.198-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 14:59:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:00:28.391-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:00:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:00:58.720-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:00:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:01:28.920-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:01:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:01:59.106-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:01:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:02:29.281-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:02:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:02:59.557-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:02:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:03:29.938-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:03:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:03:32.141-0500 [conn1782] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T15:04:00.158-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:03:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:04:30.484-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:04:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:05:00.724-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:05:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:05:30.914-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:05:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:06:01.202-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:06:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:06:31.403-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:06:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:07:01.747-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:07:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:07:32.243-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:07:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:08:02.533-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:08:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:08:32.273-0500 [conn1783] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T15:08:32.899-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:08:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:09:03.177-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:09:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:09:33.460-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:09:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:10:03.718-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:10:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:10:34.001-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:10:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:11:04.261-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:11:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:11:34.516-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:11:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:12:04.727-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:12:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:12:35.009-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:12:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:13:05.286-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:13:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:13:32.260-0500 [conn1784] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T15:13:35.578-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:13:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:14:05.867-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:14:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:14:36.108-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:14:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:15:06.261-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:15:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:15:36.496-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:15:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:16:06.698-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:16:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:16:36.971-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:16:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:17:07.248-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:17:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:17:37.535-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:17:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:18:07.702-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:18:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:18:32.225-0500 [conn1785] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T15:18:38.042-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:18:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:19:08.350-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:19:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:19:38.511-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:19:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:20:08.840-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:20:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:20:39.008-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:20:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:21:09.285-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:21:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:21:39.508-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:21:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:22:09.788-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:22:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:22:40.164-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:22:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:23:10.435-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:23:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:23:32.223-0500 [conn1786] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T15:23:40.654-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:23:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:24:10.891-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:24:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:24:41.213-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:24:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:25:11.482-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:25:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:25:41.777-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:25:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:26:12.046-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:26:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:26:42.330-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:26:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:27:12.621-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:27:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:27:42.954-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:27:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:28:13.218-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:28:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:28:32.127-0500 [conn1787] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T15:28:43.474-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:28:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:29:13.784-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:29:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:29:43.982-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:29:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:30:14.228-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:30:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:30:44.520-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:30:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:31:14.790-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:31:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:31:45.166-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:31:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:32:15.440-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:32:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:32:45.734-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:32:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:33:15.997-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:33:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:33:32.225-0500 [conn1788] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T15:33:46.312-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:33:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:34:16.621-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:34:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:34:46.792-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:34:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:35:17.050-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:35:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:35:47.324-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:35:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:36:17.624-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:36:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:36:47.916-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:36:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:37:18.202-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:37:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:37:48.493-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:37:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:38:18.760-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:38:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:38:32.116-0500 [conn1789] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T15:38:48.976-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:38:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:39:19.252-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:39:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:39:49.540-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:39:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:40:19.732-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:40:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:40:50.101-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:40:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:41:20.385-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:41:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:41:50.601-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:41:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:42:21.014-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:42:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:42:51.312-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:42:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:43:21.532-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:43:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:43:32.227-0500 [conn1790] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T15:43:51.818-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:43:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:44:22.090-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:44:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:44:52.242-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:44:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:45:22.520-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:45:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:45:52.801-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:45:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:46:23.089-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:46:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:46:53.490-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:46:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:47:23.758-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:47:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:47:53.978-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:47:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:48:24.297-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:48:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:48:32.257-0500 [conn1791] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T15:48:54.614-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:48:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:49:24.878-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:49:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:49:55.191-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:49:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:50:25.426-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:50:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:50:55.696-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:50:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:51:25.973-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:51:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:51:56.241-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:51:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:52:26.526-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:52:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:52:56.821-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:52:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:53:27.092-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:53:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:53:32.287-0500 [conn1792] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T15:53:57.465-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:53:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:54:27.886-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:54:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:54:58.074-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:54:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:55:28.344-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:55:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:55:58.672-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:55:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:56:28.865-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:56:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:56:59.154-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:56:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:57:29.350-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:57:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:57:59.520-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:57:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:58:29.810-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:58:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:58:32.288-0500 [conn1793] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T15:58:59.996-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:58:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T15:59:30.296-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 15:59:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:00:00.583-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:00:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:00:30.929-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:00:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:01:01.094-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:01:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:01:31.462-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:01:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:02:01.890-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:02:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:02:32.170-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:02:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:03:02.428-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:03:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:03:32.277-0500 [conn1794] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T16:03:32.789-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:03:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:04:03.112-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:04:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:04:33.271-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:04:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:05:03.413-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:05:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:05:33.700-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:05:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:06:04.013-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:06:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:06:34.266-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:06:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:07:04.525-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:07:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:07:34.803-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:07:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:08:05.155-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:08:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:08:32.138-0500 [conn1795] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T16:08:35.453-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:08:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:09:05.747-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:09:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:09:36.016-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:09:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:10:06.278-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:10:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:10:36.653-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:10:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:11:06.950-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:11:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:11:37.321-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:11:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:12:07.591-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:12:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:12:37.839-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:12:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:13:08.227-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:13:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:13:32.226-0500 [conn1796] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T16:13:38.410-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:13:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:14:08.595-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:14:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:14:38.747-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:14:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:15:08.906-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:15:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:15:39.152-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:15:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:16:09.336-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:16:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:16:39.622-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:16:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:17:09.883-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:17:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:17:40.078-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:17:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:18:10.361-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:18:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:18:32.286-0500 [conn1797] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T16:18:40.645-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:18:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:19:10.970-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:19:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:19:41.383-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:19:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:20:11.763-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:20:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:20:42.036-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:20:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:21:12.225-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:21:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:21:42.522-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:21:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:22:12.817-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:22:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:22:43.023-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:22:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:23:13.263-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:23:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:23:32.316-0500 [conn1798] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T16:23:43.519-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:23:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:24:13.797-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:24:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:24:44.234-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:24:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:25:14.509-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:25:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:25:44.775-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:25:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:26:14.918-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:26:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:26:45.213-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:26:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:27:15.487-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:27:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:27:45.627-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:27:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:28:15.838-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:28:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:28:32.208-0500 [conn1799] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T16:28:46.067-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:28:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:29:16.373-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:29:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:29:46.570-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:29:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:30:17.036-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:30:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:30:47.309-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:30:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:31:17.450-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:31:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:31:47.591-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:31:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:32:17.909-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:32:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:32:48.068-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:32:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:33:18.391-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:33:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:33:32.121-0500 [conn1800] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T16:33:48.525-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:33:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:34:18.859-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:34:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:34:49.294-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:34:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:35:19.564-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:35:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:35:49.860-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:35:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:36:20.276-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:36:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:36:50.568-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:36:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:37:20.848-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:37:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:37:51.138-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:37:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:38:21.308-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:38:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:38:32.242-0500 [conn1801] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T16:38:51.657-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:38:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:39:21.943-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:39:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:39:52.244-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:39:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:40:22.585-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:40:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:40:52.961-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:40:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:41:23.223-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:41:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:41:53.496-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:41:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:42:23.785-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:42:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:42:54.079-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:42:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:43:24.224-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:43:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:43:32.331-0500 [conn1802] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T16:43:54.375-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:43:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:44:24.653-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:44:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:44:54.948-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:44:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:45:25.345-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:45:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:45:55.531-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:45:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:46:25.884-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:46:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:46:56.037-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:46:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:47:26.296-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:47:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:47:56.456-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:47:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:48:26.794-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:48:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:48:32.174-0500 [conn1803] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T16:48:57.091-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:48:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:49:27.328-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:49:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:49:57.604-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:49:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:50:27.974-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:50:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:50:58.354-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:50:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:51:28.681-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:51:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:51:59.048-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:51:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:52:29.320-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:52:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:52:59.605-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:52:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:53:29.818-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:53:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:53:32.334-0500 [conn1804] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T16:54:00.083-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:53:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:54:30.356-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:54:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:55:00.670-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:55:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:55:31.004-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:55:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:56:01.293-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:56:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:56:31.442-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:56:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:57:01.730-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:57:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:57:32.004-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:57:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:58:02.343-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:58:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:58:32.267-0500 [conn1805] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T16:58:32.512-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:58:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:59:02.804-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:59:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T16:59:33.088-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 16:59:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:00:03.455-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:00:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:00:33.709-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:00:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:01:04.033-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:01:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:01:34.291-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:01:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:02:04.561-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:02:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:02:34.717-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:02:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:03:04.978-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:03:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:03:32.322-0500 [conn1806] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T17:03:35.251-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:03:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:04:05.562-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:04:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:04:35.902-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:04:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:05:06.305-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:05:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:05:36.600-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:05:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:06:06.884-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:06:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:06:37.313-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:06:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:07:07.449-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:07:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:07:37.747-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:07:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:08:08.028-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:08:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:08:32.184-0500 [conn1807] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T17:08:38.311-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:08:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:09:08.637-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:09:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:09:38.934-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:09:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:10:09.228-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:10:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:10:39.502-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:10:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:11:09.795-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:11:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:11:40.073-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:11:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:12:10.359-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:12:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:12:40.648-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:12:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:13:10.916-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:13:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:13:32.386-0500 [conn1808] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T17:13:41.280-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:13:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:14:11.574-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:14:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:14:41.762-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:14:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:15:12.029-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:15:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:15:42.274-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:15:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:16:12.540-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:16:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:16:43.105-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:16:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:17:13.532-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:17:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:17:43.921-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:17:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:18:14.237-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:18:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:18:32.224-0500 [conn1809] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T17:18:44.409-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:18:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:19:14.581-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:19:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:19:44.755-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:19:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:20:15.026-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:20:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:20:45.258-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:20:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:21:15.540-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:21:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:21:45.813-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:21:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:22:16.109-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:22:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:22:46.288-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:22:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:23:16.631-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:23:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:23:32.287-0500 [conn1810] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T17:23:46.911-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:23:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:24:17.106-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:24:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:24:47.369-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:24:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:25:17.659-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:25:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:25:47.926-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:25:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:26:18.122-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:26:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:26:48.446-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:26:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:27:18.714-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:27:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:27:49.115-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:27:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:28:19.361-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:28:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:28:32.205-0500 [conn1811] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T17:28:49.547-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:28:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:29:19.721-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:29:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:29:49.998-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:29:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:30:20.257-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:30:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:30:50.588-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:30:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:31:20.862-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:31:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:31:51.255-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:31:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:32:21.537-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:32:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:32:51.691-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:32:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:33:21.967-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:33:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:33:32.223-0500 [conn1812] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T17:33:52.322-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:33:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:34:22.464-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:34:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:34:52.750-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:34:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:35:23.044-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:35:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:35:53.202-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:35:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:36:23.463-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:36:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:36:53.711-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:36:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:37:24.063-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:37:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:37:54.370-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:37:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:38:24.764-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:38:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:38:32.275-0500 [conn1813] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T17:38:55.073-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:38:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:39:25.288-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:39:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:39:55.619-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:39:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:40:25.916-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:40:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:40:56.197-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:40:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:41:26.476-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:41:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:41:56.892-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:41:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:42:27.176-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:42:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:42:57.465-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:42:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:43:27.755-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:43:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:43:32.283-0500 [conn1814] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T17:43:58.043-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:43:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:44:28.252-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:44:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:44:58.414-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:44:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:45:28.788-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:45:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:45:59.084-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:45:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:46:29.360-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:46:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:46:59.621-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:46:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:47:29.901-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:47:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:48:00.208-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:47:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:48:30.491-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:48:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:48:32.165-0500 [conn1815] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T17:49:00.753-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:49:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:49:31.050-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:49:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:50:01.221-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:50:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:50:31.489-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:50:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:51:01.752-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:51:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:51:31.955-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:51:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:52:02.275-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:52:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:52:32.588-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:52:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:53:02.745-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:53:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:53:32.380-0500 [conn1816] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T17:53:33.031-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:53:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:54:03.204-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:54:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:54:33.514-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:54:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:55:03.779-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:55:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:55:34.069-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:55:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:56:04.247-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:56:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:56:34.588-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:56:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:57:04.889-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:57:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:57:35.047-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:57:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:58:05.320-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:58:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:58:32.162-0500 [conn1817] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T17:58:35.500-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:58:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:59:05.915-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:59:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T17:59:36.205-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 17:59:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:00:06.389-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:00:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:00:36.564-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:00:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:01:06.706-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:01:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:01:36.994-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:01:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:02:07.153-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:02:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:02:37.433-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:02:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:03:07.691-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:03:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:03:32.325-0500 [conn1818] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T18:03:37.976-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:03:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:04:08.529-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:04:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:04:38.803-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:04:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:05:09.093-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:05:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:05:39.368-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:05:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:06:09.664-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:06:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:06:40.020-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:06:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:07:10.303-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:07:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:07:40.459-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:07:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:08:10.733-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:08:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:08:32.325-0500 [conn1819] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T18:08:41.109-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:08:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:09:11.275-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:09:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:09:41.554-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:09:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:10:11.688-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:10:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:10:41.960-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:10:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:11:12.173-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:11:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:11:42.450-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:11:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:12:12.733-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:12:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:12:43.003-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:12:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:13:13.304-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:13:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:13:32.237-0500 [conn1820] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T18:13:43.548-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:13:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:14:13.884-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:14:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:14:44.178-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:14:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:15:14.440-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:15:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:15:44.707-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:15:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:16:14.941-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:16:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:16:45.295-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:16:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:17:15.692-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:17:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:17:45.885-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:17:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:18:16.092-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:18:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:18:32.316-0500 [conn1821] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T18:18:46.361-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:18:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:19:16.621-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:19:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:19:46.883-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:19:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:20:17.137-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:20:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:20:47.413-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:20:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:21:17.682-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:21:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:21:48.016-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:21:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:22:18.365-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:22:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:22:48.500-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:22:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:23:18.638-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:23:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:23:32.186-0500 [conn1822] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T18:23:49.041-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:23:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:24:19.319-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:24:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:24:49.658-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:24:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:25:19.956-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:25:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:25:50.128-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:25:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:26:20.421-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:26:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:26:50.750-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:26:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:27:21.035-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:27:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:27:51.292-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:27:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:28:21.606-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:28:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:28:32.293-0500 [conn1823] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T18:28:51.988-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:28:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:29:22.263-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:29:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:29:52.677-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:29:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:30:22.931-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:30:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:30:53.213-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:30:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:31:23.500-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:31:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:31:53.766-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:31:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:32:24.056-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:32:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:32:54.420-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:32:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:33:24.652-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:33:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:33:32.277-0500 [conn1824] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T18:33:54.932-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:33:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:34:25.181-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:34:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:34:55.443-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:34:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:35:25.741-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:35:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:35:56.035-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:35:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:36:26.355-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:36:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:36:56.623-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:36:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:37:27.035-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:37:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:37:57.495-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:37:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:38:27.772-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:38:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:38:32.245-0500 [conn1825] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T18:38:58.132-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:38:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:39:28.376-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:39:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:39:58.779-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:39:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:40:29.045-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:40:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:40:59.348-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:40:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:41:29.694-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:41:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:42:00.032-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:41:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:42:30.294-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:42:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:43:00.471-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:43:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:43:30.758-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:43:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:43:32.209-0500 [conn1826] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T18:44:01.037-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:44:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:44:31.338-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:44:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:45:01.611-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:45:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:45:31.902-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:45:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:46:02.175-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:46:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:46:32.324-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:46:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:47:02.595-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:47:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:47:32.857-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:47:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:48:03.146-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:48:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:48:32.203-0500 [conn1827] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T18:48:33.462-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:48:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:49:03.757-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:49:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:49:34.066-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:49:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:50:04.415-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:50:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:50:34.694-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:50:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:51:04.962-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:51:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:51:35.223-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:51:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:52:05.512-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:52:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:52:35.792-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:52:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:53:06.070-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:53:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:53:32.319-0500 [conn1828] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T18:53:36.260-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:53:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:54:06.546-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:54:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:54:36.828-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:54:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:55:07.109-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:55:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:55:37.435-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:55:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:56:07.633-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:56:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:56:37.807-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:56:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:57:08.109-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:57:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:57:38.388-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:57:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:58:08.676-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:58:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:58:32.448-0500 [conn1829] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T18:58:39.092-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:58:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:59:09.270-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:59:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T18:59:39.529-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 18:59:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:00:09.697-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:00:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:00:39.960-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:00:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:01:10.180-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:01:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:01:40.461-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:01:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:02:10.735-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:02:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:02:40.901-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:02:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:03:11.172-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:03:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:03:32.146-0500 [conn1830] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T19:03:41.499-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:03:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:04:11.796-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:04:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:04:41.955-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:04:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:05:12.262-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:05:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:05:42.569-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:05:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:06:12.886-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:06:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:06:43.139-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:06:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:07:13.426-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:07:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:07:43.615-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:07:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:08:13.994-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:08:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:08:32.403-0500 [conn1831] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T19:08:44.371-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:08:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:09:14.738-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:09:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:09:44.926-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:09:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:10:15.246-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:10:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:10:45.559-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:10:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:11:15.709-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:11:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:11:46.073-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:11:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:12:16.357-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:12:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:12:46.734-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:12:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:13:16.868-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:13:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:13:32.142-0500 [conn1832] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T19:13:47.128-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:13:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:14:17.439-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:14:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:14:47.672-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:14:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:15:17.903-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:15:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:15:48.137-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:15:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:16:18.273-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:16:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:16:48.480-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:16:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:17:18.765-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:17:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:17:49.054-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:17:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:18:19.316-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:18:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:18:32.175-0500 [conn1833] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T19:18:49.583-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:18:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:19:19.724-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:19:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:19:50.008-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:19:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:20:20.280-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:20:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:20:50.558-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:20:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:21:20.933-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:21:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:21:51.227-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:21:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:22:21.422-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:22:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:22:51.626-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:22:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:23:21.890-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:23:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:23:32.440-0500 [conn1834] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T19:23:52.164-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:23:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:24:22.592-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:24:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:24:52.758-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:24:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:25:23.052-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:25:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:25:53.295-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:25:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:26:23.678-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:26:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:26:53.864-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:26:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:27:24.078-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:27:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:27:54.371-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:27:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:28:24.641-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:28:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:28:32.230-0500 [conn1835] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T19:28:54.941-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:28:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:29:25.107-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:29:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:29:55.342-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:29:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:30:25.617-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:30:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:30:55.880-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:30:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:31:26.118-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:31:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:31:56.429-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:31:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:32:26.694-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:32:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:32:56.956-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:32:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:33:27.264-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:33:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:33:32.292-0500 [conn1836] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T19:33:57.647-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:33:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:34:28.009-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:34:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:34:58.289-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:34:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:35:28.463-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:35:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:35:58.815-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:35:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:36:29.093-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:36:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:36:59.369-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:36:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:37:29.648-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:37:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:37:59.960-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:37:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:38:30.284-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:38:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:38:32.258-0500 [conn1837] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T19:39:00.513-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:39:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:39:30.873-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:39:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:40:01.275-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:40:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:40:31.548-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:40:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:41:01.884-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:41:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:41:32.182-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:41:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:42:02.451-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:42:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:42:32.736-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:42:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:43:02.991-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:43:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:43:32.351-0500 [conn1838] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T19:43:33.294-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:43:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:44:03.594-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:44:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:44:33.894-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:44:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:45:04.219-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:45:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:45:34.362-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:45:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:46:04.665-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:46:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:46:34.838-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:46:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:47:05.124-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:47:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:47:35.454-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:47:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:48:05.715-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:48:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:48:32.295-0500 [conn1839] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T19:48:35.948-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:48:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:49:06.209-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:49:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:49:36.518-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:49:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:50:06.755-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:50:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:50:36.948-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:50:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:51:07.141-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:51:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:51:37.365-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:51:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:52:07.737-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:52:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:52:38.033-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:52:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:53:08.309-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:53:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:53:32.293-0500 [conn1840] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T19:53:38.617-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:53:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:54:08.878-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:54:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:54:39.148-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:54:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:55:09.439-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:55:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:55:39.763-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:55:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:56:10.057-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:56:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:56:40.288-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:56:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:57:10.605-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:57:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:57:40.860-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:57:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:58:11.097-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:58:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:58:32.263-0500 [conn1841] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T19:58:41.373-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:58:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:59:11.640-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:59:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T19:59:41.941-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 19:59:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:00:12.143-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:00:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:00:42.338-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:00:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:01:12.534-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:01:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:01:42.683-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:01:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:02:12.835-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:02:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:02:43.115-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:02:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:03:13.397-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:03:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:03:32.783-0500 [conn1842] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T20:03:43.775-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:03:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:04:14.116-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:04:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:04:44.417-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:04:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:05:14.732-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:05:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:05:44.916-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:05:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:06:15.138-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:06:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:06:45.459-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:06:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:07:15.774-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:07:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:07:46.040-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:07:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:08:16.319-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:08:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:08:32.102-0500 [conn1843] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T20:08:46.599-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:08:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:09:16.925-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:09:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:09:47.316-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:09:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:10:17.708-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:10:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:10:47.940-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:10:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:11:18.129-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:11:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:11:48.455-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:11:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:12:18.790-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:12:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:12:49.073-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:12:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:13:19.354-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:13:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:13:32.422-0500 [conn1844] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T20:13:49.621-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:13:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:14:19.915-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:14:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:14:50.093-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:14:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:15:20.263-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:15:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:15:50.462-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:15:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:16:20.764-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:16:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:16:51.054-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:16:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:17:21.229-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:17:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:17:51.594-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:17:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:18:21.895-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:18:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:18:32.255-0500 [conn1845] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T20:18:52.300-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:18:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:19:22.544-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:19:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:19:52.821-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:19:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:20:23.151-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:20:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:20:53.335-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:20:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:21:23.607-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:21:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:21:53.900-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:21:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:22:24.107-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:22:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:22:54.388-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:22:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:23:24.683-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:23:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:23:32.177-0500 [conn1846] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T20:23:55.009-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:23:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:24:25.244-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:24:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:24:55.375-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:24:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:25:25.646-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:25:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:25:55.967-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:25:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:26:26.230-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:26:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:26:56.541-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:26:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:27:26.826-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:27:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:27:57.130-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:27:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:28:27.421-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:28:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:28:32.299-0500 [conn1847] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T20:28:57.567-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:28:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:29:27.932-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:29:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:29:58.263-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:29:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:30:28.446-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:30:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:30:58.729-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:30:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:31:28.988-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:31:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:31:59.271-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:31:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:32:29.579-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:32:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:32:59.714-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:32:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:33:30.047-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:33:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:33:32.307-0500 [conn1848] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T20:34:00.467-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:34:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:34:30.751-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:34:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:35:00.975-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:35:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:35:31.122-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:35:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:36:01.396-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:36:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:36:31.718-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:36:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:37:01.998-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:37:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:37:32.253-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:37:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:38:02.532-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:38:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:38:32.326-0500 [conn1849] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T20:38:32.832-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:38:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:39:02.998-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:39:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:39:33.317-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:39:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:40:03.590-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:40:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:40:33.871-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:40:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:41:04.151-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:41:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:41:34.432-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:41:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:42:04.658-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:42:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:42:35.132-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:42:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:43:05.391-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:43:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:43:32.192-0500 [conn1850] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T20:43:35.659-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:43:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:44:05.798-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:44:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:44:36.014-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:44:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:45:06.198-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:45:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:45:36.516-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:45:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:46:06.782-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:46:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:46:37.065-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:46:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:47:07.334-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:47:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:47:37.519-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:47:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:48:07.677-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:48:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:48:32.231-0500 [conn1851] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T20:48:37.978-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:48:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:49:08.253-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:49:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:49:38.497-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:49:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:50:08.662-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:50:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:50:39.018-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:50:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:51:09.301-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:51:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:51:39.628-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:51:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:52:09.918-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:52:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:52:40.090-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:52:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:53:10.404-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:53:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:53:32.242-0500 [conn1852] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T20:53:40.698-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:53:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:54:11.039-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:54:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:54:41.307-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:54:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:55:11.577-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:55:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:55:41.729-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:55:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:56:12.084-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:56:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:56:42.416-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:56:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:57:12.871-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:57:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:57:43.124-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:57:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:58:13.426-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:58:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:58:32.196-0500 [conn1853] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T20:58:43.827-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:58:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:59:14.618-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:59:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T20:59:44.884-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 20:59:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:00:15.015-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:00:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:00:45.331-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:00:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:01:15.702-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:01:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:01:45.987-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:01:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:02:16.293-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:02:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:02:46.652-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:02:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:03:16.939-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:03:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:03:32.313-0500 [conn1854] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T21:03:47.193-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:03:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:04:17.327-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:04:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:04:47.474-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:04:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:05:17.832-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:05:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:05:48.106-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:05:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:06:18.297-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:06:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:06:48.552-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:06:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:07:18.825-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:07:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:07:49.089-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:07:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:08:19.308-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:08:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:08:32.332-0500 [conn1855] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T21:08:49.571-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:08:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:09:19.809-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:09:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:09:50.214-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:09:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:10:20.564-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:10:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:10:50.903-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:10:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:11:21.138-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:11:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:11:51.388-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:11:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:12:21.659-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:12:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:12:51.931-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:12:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:13:22.244-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:13:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:13:32.388-0500 [conn1856] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T21:13:52.408-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:13:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:14:22.547-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:14:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:14:52.823-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:14:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:15:23.095-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:15:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:15:53.363-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:15:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:16:23.605-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:16:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:16:53.792-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:16:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:17:24.072-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:17:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:17:54.350-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:17:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:18:24.661-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:18:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:18:32.161-0500 [conn1857] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T21:18:54.847-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:18:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:19:25.139-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:19:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:19:55.342-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:19:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:20:25.603-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:20:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:20:55.916-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:20:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:21:26.079-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:21:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:21:56.365-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:21:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:22:26.820-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:22:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:22:57.089-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:22:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:23:27.355-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:23:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:23:33.004-0500 [conn1858] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T21:23:57.562-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:23:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:24:27.888-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:24:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:24:58.019-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:24:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:25:28.348-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:25:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:25:58.567-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:25:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:26:28.774-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:26:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:26:59.059-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:26:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:27:29.382-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:27:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:27:59.722-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:27:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:28:30.008-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:28:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:28:32.138-0500 [conn1859] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T21:29:00.279-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:29:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:29:30.474-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:29:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:30:00.705-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:30:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:30:31.069-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:30:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:31:01.345-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:31:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:31:31.589-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:31:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:32:02.028-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:32:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:32:32.224-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:32:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:33:02.428-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:33:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:33:32.166-0500 [conn1860] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T21:33:32.730-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:33:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:34:03.073-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:34:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:34:33.223-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:34:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:35:03.591-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:35:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:35:33.787-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:35:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:36:04.121-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:36:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:36:34.386-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:36:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:37:04.658-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:37:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:37:34.967-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:37:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:38:05.287-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:38:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:38:32.293-0500 [conn1861] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T21:38:35.509-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:38:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:39:05.828-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:39:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:39:36.273-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:39:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:40:06.489-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:40:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:40:36.648-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:40:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:41:06.946-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:41:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:41:37.230-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:41:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:42:07.390-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:42:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:42:37.624-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:42:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:43:07.926-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:43:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:43:32.363-0500 [conn1862] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T21:43:38.183-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:43:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:44:08.467-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:44:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:44:38.693-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:44:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:45:09.018-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:45:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:45:39.335-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:45:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:46:09.625-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:46:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:46:39.975-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:46:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:47:10.254-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:47:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:47:40.414-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:47:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:48:10.692-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:48:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:48:32.324-0500 [conn1863] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T21:48:41.124-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:48:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:49:11.283-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:49:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:49:41.583-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:49:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:50:11.928-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:50:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:50:42.195-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:50:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:51:12.588-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:51:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:51:42.918-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:51:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:52:13.176-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:52:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:52:43.324-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:52:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:53:13.678-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:53:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:53:32.311-0500 [conn1864] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T21:53:43.959-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:53:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:54:14.135-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:54:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:54:44.450-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:54:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:55:14.712-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:55:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:55:44.922-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:55:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:56:15.193-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:56:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:56:45.333-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:56:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:57:15.560-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:57:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:57:45.719-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:57:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:58:15.948-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:58:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:58:32.206-0500 [conn1865] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T21:58:46.248-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:58:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:59:16.804-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:59:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T21:59:46.976-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 21:59:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:00:17.265-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:00:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:00:47.533-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:00:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:01:17.755-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:01:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:01:48.086-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:01:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:02:18.346-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:02:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:02:48.630-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:02:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:03:18.915-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:03:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:03:32.123-0500 [conn1866] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T22:03:49.243-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:03:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:04:19.536-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:04:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:04:49.838-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:04:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:05:20.033-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:05:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:05:50.280-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:05:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:06:20.468-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:06:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:06:50.743-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:06:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:07:21.110-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:07:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:07:51.383-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:07:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:08:21.585-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:08:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:08:32.296-0500 [conn1867] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T22:08:51.796-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:08:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:09:22.098-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:09:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:09:52.382-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:09:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:10:22.559-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:10:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:10:52.928-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:10:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:11:23.218-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:11:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:11:53.529-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:11:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:12:23.886-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:12:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:12:54.186-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:12:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:13:24.486-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:13:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:13:32.311-0500 [conn1868] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T22:13:54.776-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:13:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:14:25.192-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:14:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:14:55.490-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:14:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:15:25.781-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:15:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:15:56.085-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:15:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:16:26.244-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:16:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:16:56.526-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:16:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:17:26.667-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:17:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:17:56.938-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:17:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:18:27.162-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:18:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:18:32.300-0500 [conn1869] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T22:18:57.429-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:18:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:19:27.675-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:19:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:19:57.921-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:19:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:20:28.122-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:20:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:20:58.416-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:20:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:21:28.593-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:21:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:21:58.849-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:21:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:22:29.114-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:22:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:22:59.398-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:22:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:23:29.570-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:23:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:23:32.359-0500 [conn1870] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T22:23:59.741-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:23:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:24:29.959-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:24:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:25:00.128-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:24:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:25:30.407-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:25:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:26:00.629-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:26:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:26:30.926-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:26:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:27:01.202-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:27:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:27:31.484-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:27:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:28:01.854-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:28:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:28:32.066-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:28:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:28:32.289-0500 [conn1871] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T22:29:02.355-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:29:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:29:32.668-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:29:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:30:02.960-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:30:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:30:33.262-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:30:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:31:03.436-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:31:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:31:33.747-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:31:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:32:03.888-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:32:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:32:34.188-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:32:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:33:04.401-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:33:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:33:32.386-0500 [conn1872] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T22:33:34.665-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:33:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:34:04.983-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:34:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:34:35.255-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:34:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:35:05.588-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:35:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:35:35.859-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:35:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:36:06.042-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:36:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:36:36.305-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:36:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:37:06.642-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:37:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:37:36.826-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:37:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:38:07.107-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:38:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:38:32.243-0500 [conn1873] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T22:38:37.318-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:38:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:39:07.657-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:39:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:39:37.933-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:39:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:40:08.214-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:40:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:40:38.506-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:40:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:41:08.827-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:41:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:41:39.186-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:41:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:42:09.463-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:42:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:42:39.779-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:42:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:43:10.122-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:43:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:43:32.589-0500 [conn1874] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T22:43:40.406-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:43:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:44:10.828-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:44:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:44:41.129-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:44:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:45:11.417-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:45:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:45:41.688-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:45:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:46:11.968-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:46:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:46:42.257-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:46:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:47:12.545-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:47:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:47:42.848-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:47:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:48:13.198-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:48:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:48:32.239-0500 [conn1875] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T22:48:43.493-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:48:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:49:13.779-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:49:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:49:44.092-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:49:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:50:14.397-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:50:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:50:44.608-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:50:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:51:14.986-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:51:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:51:45.277-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:51:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:52:15.561-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:52:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:52:45.883-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:52:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:53:16.039-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:53:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:53:32.286-0500 [conn1876] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T22:53:46.309-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:53:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:54:16.555-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:54:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:54:46.683-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:54:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:55:16.885-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:55:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:55:47.152-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:55:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:56:17.293-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:56:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:56:47.583-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:56:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:57:17.784-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:57:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:57:48.209-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:57:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:58:18.433-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:58:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:58:32.188-0500 [conn1877] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T22:58:48.727-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:58:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:59:19.004-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:59:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T22:59:49.169-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 22:59:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:00:19.543-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:00:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:00:49.703-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:00:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:01:19.967-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:01:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:01:50.243-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:01:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:02:20.565-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:02:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:02:50.851-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:02:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:03:21.151-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:03:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:03:32.198-0500 [conn1878] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T23:03:51.468-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:03:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:04:21.767-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:04:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:04:52.055-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:04:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:05:22.312-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:05:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:05:52.496-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:05:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:06:22.805-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:06:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:06:53.182-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:06:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:07:23.381-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:07:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:07:53.671-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:07:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:08:24.001-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:08:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:08:32.224-0500 [conn1879] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T23:08:54.169-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:08:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:09:24.435-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:09:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:09:54.705-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:09:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:10:24.983-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:10:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:10:55.300-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:10:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:11:25.648-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:11:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:11:55.935-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:11:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:12:26.195-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:12:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:12:56.482-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:12:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:13:26.716-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:13:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:13:32.136-0500 [conn1880] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T23:13:56.982-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:13:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:14:27.247-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:14:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:14:57.413-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:14:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:15:27.677-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:15:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:15:57.900-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:15:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:16:28.182-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:16:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:16:58.432-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:16:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:17:28.788-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:17:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:17:59.097-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:17:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:18:29.375-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:18:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:18:32.153-0500 [conn1881] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T23:18:59.635-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:18:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:19:29.910-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:19:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:20:00.202-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:19:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:20:30.487-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:20:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:21:00.787-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:21:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:21:31.062-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:21:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:22:01.440-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:22:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:22:31.712-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:22:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:23:01.952-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:23:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:23:32.246-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:23:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:23:32.248-0500 [conn1882] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T23:24:02.530-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:24:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:24:32.811-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:24:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:25:03.082-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:25:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:25:33.475-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:25:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:26:03.838-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:26:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:26:34.022-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:26:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:27:04.323-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:27:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:27:34.622-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:27:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:28:04.764-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:28:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:28:32.188-0500 [conn1883] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T23:28:35.028-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:28:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:29:05.442-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:29:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:29:35.730-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:29:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:30:05.993-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:30:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:30:36.313-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:30:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:31:06.463-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:31:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:31:36.719-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:31:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:32:06.988-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:32:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:32:37.331-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:32:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:33:07.625-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:33:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:33:32.259-0500 [conn1884] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T23:33:37.785-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:33:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:34:08.084-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:34:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:34:38.354-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:34:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:35:08.744-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:35:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:35:39.013-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:35:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:36:09.340-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:36:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:36:39.653-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:36:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:37:09.929-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:37:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:37:40.292-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:37:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:38:10.559-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:38:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:38:32.212-0500 [conn1885] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T23:38:40.856-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:38:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:39:11.134-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:39:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:39:41.419-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:39:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:40:11.683-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:40:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:40:42.000-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:40:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:41:12.277-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:41:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:41:42.557-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:41:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:42:12.807-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:42:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:42:43.082-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:42:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:43:13.390-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:43:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:43:32.205-0500 [conn1886] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T23:43:43.579-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:43:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:44:13.720-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:44:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:44:44.172-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:44:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:45:14.464-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:45:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:45:44.736-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:45:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:46:15.139-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:46:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:46:45.432-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:46:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:47:15.719-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:47:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:47:46.018-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:47:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:48:16.301-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:48:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:48:32.352-0500 [conn1887] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T23:48:46.555-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:48:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:49:16.718-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:49:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:49:46.996-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:49:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:50:17.338-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:50:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:50:47.620-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:50:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:51:17.906-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:51:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:51:48.094-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:51:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:52:18.500-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:52:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:52:48.665-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:52:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:53:18.929-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:53:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:53:32.155-0500 [conn1888] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T23:53:49.220-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:53:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:54:19.497-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:54:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:54:49.696-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:54:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:55:19.988-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:55:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:55:50.261-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:55:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:56:20.588-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:56:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:56:50.852-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:56:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:57:21.222-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:57:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:57:51.524-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:57:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:58:21.686-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:58:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:58:32.180-0500 [conn1889] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-28T23:58:51.962-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:58:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:59:22.204-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:59:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-28T23:59:52.485-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sat Jan 28 23:59:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:00:07.053-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:00:07.053-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:00:22.784-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:00:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:00:53.170-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:00:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:01:02.084-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:01:02.084-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:01:23.370-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:01:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:01:38.589-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588d7731f2367042e84ec78e') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485666098478), why: "doing balance round", ts: ObjectId('588d77329527cdec667c1349') } } gle1: { lastOp: Timestamp 1485666098000|18, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 2, writtenTo: null, err: null, waited: 2, ok: 1.0 } gle2: { lastOp: Timestamp 1485586798000|26, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 22, writtenTo: null, err: null, waited: 22, ok: 1.0 } 2017-01-29T00:01:38.598-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-29T00:01:38.769-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d77329527cdec667c1349 2017-01-29T00:01:39.366-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:01:51.756-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d773f9527cdec667c134a 2017-01-29T00:01:52.453-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:01:53.670-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:01:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:01:58.776-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d77469527cdec667c134b 2017-01-29T00:01:59.377-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:02:23.964-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:02:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:02:54.247-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:02:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:03:06.513-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d778a9527cdec667c134c 2017-01-29T00:03:07.116-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:03:19.603-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d77979527cdec667c134d 2017-01-29T00:03:20.269-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:03:24.478-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:03:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:03:32.275-0500 [conn1890] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T00:03:38.760-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d77aa9527cdec667c134e 2017-01-29T00:03:39.360-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:03:54.628-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:03:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:04:24.926-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:04:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:04:55.203-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:04:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:05:25.442-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:05:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:05:28.866-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:05:28.867-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:05:55.687-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:05:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:06:05.589-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d783d9527cdec667c1350 2017-01-29T00:06:06.281-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:06:12.637-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d78449527cdec667c1351 2017-01-29T00:06:13.416-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:06:25.973-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:06:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:06:43.867-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:06:43.867-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:06:56.126-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:06:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:07:08.541-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d787c9527cdec667c1353 2017-01-29T00:07:09.298-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:07:15.531-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d78839527cdec667c1354 2017-01-29T00:07:16.194-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:07:22.373-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:07:22.373-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:07:26.486-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:07:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:07:56.633-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:07:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:07:59.154-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d78ae9527cdec667c1356 2017-01-29T00:07:59.795-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:08:24.209-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:08:24.209-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:08:26.956-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:08:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:08:32.234-0500 [conn1891] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T00:08:48.702-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d78e09527cdec667c1358 2017-01-29T00:08:49.433-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:08:57.146-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:08:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:09:01.838-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d78ed9527cdec667c1359 2017-01-29T00:09:02.501-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:09:20.898-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d79009527cdec667c135a 2017-01-29T00:09:21.568-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:09:27.485-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:09:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:09:57.870-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:09:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:10:16.425-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d79389527cdec667c135b 2017-01-29T00:10:17.063-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:10:28.162-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:10:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:10:35.489-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:10:35.489-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:10:58.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:10:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:11:05.929-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:11:05.929-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:11:28.696-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:11:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:11:58.890-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:11:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:12:00.695-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:12:00.695-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:12:19.139-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d79b29527cdec667c135f 2017-01-29T00:12:19.913-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:12:29.106-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:12:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:12:59.242-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:12:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:13:29.514-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:13:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:13:32.316-0500 [conn1892] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T00:13:59.914-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:13:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:14:30.254-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:14:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:15:00.443-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:15:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:15:10.024-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:15:10.024-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:15:30.730-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:15:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:16:01.033-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:16:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:16:04.777-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:16:04.777-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:16:17.031-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588d7aa0e6f83b6d553ceb9e') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485666976902), why: "doing balance round", ts: ObjectId('588d7aa09527cdec667c1362') } } gle1: { lastOp: Timestamp 1485666976000|29, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 26, writtenTo: null, err: null, waited: 26, ok: 1.0 } gle2: { lastOp: Timestamp 1485666739000|26, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 34, writtenTo: null, err: null, waited: 34, ok: 1.0 } 2017-01-29T00:16:17.041-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-29T00:16:17.177-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d7aa09527cdec667c1362 2017-01-29T00:16:17.855-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:16:31.301-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:16:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:17:01.561-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:17:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:17:31.878-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:17:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:18:02.206-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:18:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:18:25.781-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:18:25.781-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:18:32.119-0500 [conn1893] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T00:18:32.485-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:18:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:18:50.466-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d7b3a9527cdec667c1364 2017-01-29T00:18:51.348-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:19:02.712-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:19:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:19:33.089-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:19:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:19:52.201-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:19:52.201-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:19:58.497-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d7b7e9527cdec667c1366 2017-01-29T00:19:59.270-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:20:03.543-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:20:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:20:23.843-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:20:23.843-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:20:30.087-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d7b9d9527cdec667c1368 2017-01-29T00:20:30.751-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:20:33.680-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:20:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:20:49.210-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d7bb09527cdec667c1369 2017-01-29T00:20:49.950-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:21:04.066-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:21:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:21:08.451-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d7bc49527cdec667c136a 2017-01-29T00:21:09.223-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:21:34.331-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:21:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:21:51.996-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d7bef9527cdec667c136b 2017-01-29T00:21:52.731-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:22:04.518-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:22:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:22:23.193-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d7c0f9527cdec667c136c 2017-01-29T00:22:23.768-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:22:29.986-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:22:29.986-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:22:34.698-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:22:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:23:04.956-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:23:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:23:06.727-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d7c3a9527cdec667c136e 2017-01-29T00:23:07.296-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:23:32.389-0500 [conn1894] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T00:23:35.096-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:23:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:24:02.116-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:24:02.116-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:24:05.375-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:24:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:24:35.629-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:24:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:24:38.652-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:24:38.652-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:24:44.951-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:24:44.952-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:25:05.802-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:25:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:25:21.814-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:25:21.815-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:25:35.962-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:25:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:26:06.265-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:26:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:26:10.541-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:26:10.541-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:26:36.551-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:26:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:26:41.031-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:26:41.031-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:27:06.798-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:27:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:27:17.677-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:27:17.677-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:27:37.064-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:27:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:27:48.316-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:27:48.316-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:28:00.584-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:28:00.584-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:28:07.332-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:28:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:28:12.956-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588d7d6bca3906e0a9d426fe') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485667692804), why: "doing balance round", ts: ObjectId('588d7d6c9527cdec667c1378') } } gle1: { lastOp: Timestamp 1485667387000|6, connectionId: 21778, updatedExisting: false, n: 0, syncMillis: 21, writtenTo: null, err: null, waited: 21, ok: 1.0 } gle2: { lastOp: Timestamp 1485667692000|16, connectionId: 6379656, updatedExisting: true, n: 1, syncMillis: 28, writtenTo: null, err: null, waited: 28, ok: 1.0 } 2017-01-29T00:28:12.963-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-29T00:28:12.963-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:28:32.310-0500 [conn1895] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T00:28:37.663-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:28:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:28:37.663-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-29T00:28:37.804-0500 [LockPinger] handled late remove of old distributed lock with ts 588d7d6c9527cdec667c1378 2017-01-29T00:28:43.550-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d7d8b9527cdec667c1379 2017-01-29T00:28:44.262-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:29:08.143-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:29:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:29:38.397-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:29:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:30:08.615-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:30:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:30:38.940-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:30:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:30:58.097-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588d7e1185950f1c7b9d943a') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485667857879), why: "doing balance round", ts: ObjectId('588d7e119527cdec667c137a') } } gle1: { lastOp: Timestamp 1485667724000|4, connectionId: 21778, updatedExisting: false, n: 0, syncMillis: 2, writtenTo: null, err: null, waited: 2, ok: 1.0 } gle2: { lastOp: Timestamp 1485667858000|1, connectionId: 393608, updatedExisting: true, n: 1, syncMillis: 24, writtenTo: null, err: null, waited: 24, ok: 1.0 } 2017-01-29T00:30:58.105-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-29T00:30:58.105-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:31:09.215-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:31:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:31:09.215-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-29T00:31:09.353-0500 [LockPinger] handled late remove of old distributed lock with ts 588d7e119527cdec667c137a 2017-01-29T00:31:39.530-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:31:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:32:09.812-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:32:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:32:39.946-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:32:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:32:53.751-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:32:53.751-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:32:59.978-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:32:59.978-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:33:10.209-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:33:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:33:30.440-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:33:30.440-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:33:32.169-0500 [conn1896] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T00:33:36.650-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:33:36.650-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:33:40.472-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:33:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:33:48.933-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588d7ebbef521db6cf12267e') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485668028775), why: "doing balance round", ts: ObjectId('588d7ebc9527cdec667c137f') } } gle1: { lastOp: Timestamp 1485668028000|21, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 30, writtenTo: null, err: null, waited: 30, ok: 1.0 } gle2: { lastOp: Timestamp 1485667724000|4, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 28, writtenTo: null, err: null, waited: 28, ok: 1.0 } 2017-01-29T00:33:48.942-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-29T00:33:48.942-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:33:55.281-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d7ec39527cdec667c1380 2017-01-29T00:33:55.952-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:34:10.764-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:34:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:34:10.764-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-29T00:34:10.903-0500 [LockPinger] handled late remove of old distributed lock with ts 588d7ebc9527cdec667c137f 2017-01-29T00:34:14.441-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d7ed69527cdec667c1381 2017-01-29T00:34:15.211-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:34:21.422-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d7edd9527cdec667c1382 2017-01-29T00:34:22.191-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:34:28.397-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:34:28.397-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:34:41.251-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:34:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:35:11.411-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:35:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:35:41.656-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:35:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:36:11.928-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:36:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:36:42.208-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:36:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:37:12.418-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:37:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:37:42.686-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:37:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:38:12.964-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:38:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:38:19.500-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:38:19.500-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:38:25.821-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:38:25.821-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:38:32.198-0500 [conn1897] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T00:38:43.255-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:38:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:39:08.454-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:39:08.454-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:39:13.576-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:39:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:39:14.686-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:39:14.687-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:39:43.866-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:39:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:39:45.154-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:39:45.155-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:40:14.159-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:40:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:40:39.931-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:40:39.931-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:40:44.301-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:40:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:40:52.298-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d80649527cdec667c138a 2017-01-29T00:40:53.137-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:41:14.744-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:41:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:41:17.736-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d807d9527cdec667c138b 2017-01-29T00:41:18.356-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:41:24.682-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d80849527cdec667c138c 2017-01-29T00:41:25.387-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:41:45.056-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:41:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:41:55.980-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d80a39527cdec667c138d 2017-01-29T00:41:56.646-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:42:09.138-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d80b09527cdec667c138e 2017-01-29T00:42:09.737-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:42:15.338-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:42:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:42:28.085-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:42:28.085-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:42:45.629-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:42:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:43:04.672-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:43:04.672-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:43:15.951-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:43:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:43:32.373-0500 [conn1898] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T00:43:46.190-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:43:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:44:11.888-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588d812b89b67e1cf674cbbd') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485668651766), why: "doing balance round", ts: ObjectId('588d812b9527cdec667c1391') } } gle1: { lastOp: Timestamp 1485668529000|23, connectionId: 21778, updatedExisting: false, n: 0, syncMillis: 32, writtenTo: null, err: null, waited: 32, ok: 1.0 } gle2: { lastOp: Timestamp 1485668651000|45, connectionId: 6379656, updatedExisting: true, n: 1, syncMillis: 11, writtenTo: null, err: null, waited: 11, ok: 1.0 } 2017-01-29T00:44:11.894-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-29T00:44:11.894-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:44:16.568-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:44:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:44:16.568-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-29T00:44:16.675-0500 [LockPinger] handled late remove of old distributed lock with ts 588d812b9527cdec667c1391 2017-01-29T00:44:18.098-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d81319527cdec667c1392 2017-01-29T00:44:18.880-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:44:47.178-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:44:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:44:49.435-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d81519527cdec667c1393 2017-01-29T00:44:50.133-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:45:17.462-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:45:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:45:20.777-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d81709527cdec667c1394 2017-01-29T00:45:21.466-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:45:40.106-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d81839527cdec667c1395 2017-01-29T00:45:40.803-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:45:47.041-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d818a9527cdec667c1396 2017-01-29T00:45:47.630-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:45:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:45:47.666-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:45:54.041-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d81919527cdec667c1397 2017-01-29T00:45:54.721-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:46:17.852-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:46:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:46:19.205-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:46:19.205-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:46:25.454-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:46:25.454-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:46:48.124-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:46:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:47:08.089-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:47:08.089-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:47:18.385-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:47:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:47:44.649-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:47:44.649-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:47:48.716-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:47:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:48:19.140-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:48:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:48:32.083-0500 [conn1899] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T00:48:49.366-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:48:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:49:19.605-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:49:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:49:28.134-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588d8267a3570fe1db4424b2') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485668968027), why: "doing balance round", ts: ObjectId('588d82689527cdec667c139c') } } gle1: { lastOp: Timestamp 1485668968000|11, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 12, writtenTo: null, err: null, waited: 12, ok: 1.0 } gle2: { lastOp: Timestamp 1485668754000|32, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 5, writtenTo: null, err: null, waited: 5, ok: 1.0 } 2017-01-29T00:49:28.145-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-29T00:49:28.145-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:49:49.832-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:49:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:49:49.833-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-29T00:49:49.905-0500 [LockPinger] handled late remove of old distributed lock with ts 588d82689527cdec667c139c 2017-01-29T00:50:04.805-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d828c9527cdec667c139d 2017-01-29T00:50:05.620-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:50:20.088-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:50:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:50:50.409-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:50:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:50:54.447-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d82be9527cdec667c139e 2017-01-29T00:50:55.106-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:51:20.545-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:51:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:51:25.663-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d82dd9527cdec667c139f 2017-01-29T00:51:26.304-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:51:50.828-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:51:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:52:14.972-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:52:14.972-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:52:21.056-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:52:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:52:45.593-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d832d9527cdec667c13a1 2017-01-29T00:52:46.212-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:52:51.379-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:52:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:52:58.607-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d833a9527cdec667c13a2 2017-01-29T00:52:59.382-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:53:21.650-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:53:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:53:32.076-0500 [conn1900] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T00:53:51.867-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:53:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:53:54.126-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:53:54.126-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:54:22.159-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:54:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:54:24.738-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:54:24.739-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:54:49.267-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d83a89527cdec667c13a5 2017-01-29T00:54:50.087-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:54:52.390-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:54:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:55:22.745-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:55:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:55:50.901-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:55:50.901-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:55:53.095-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:55:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:56:23.348-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:56:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:56:39.606-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:56:39.606-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:56:53.608-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:56:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:56:57.967-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:56:57.967-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:57:23.968-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:57:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:57:54.369-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:57:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:58:04.923-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d846c9527cdec667c13a9 2017-01-29T00:58:05.555-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:58:24.705-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:58:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:58:30.160-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d84859527cdec667c13aa 2017-01-29T00:58:31.042-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T00:58:32.085-0500 [conn1901] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T00:58:37.310-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:58:37.310-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:58:49.667-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:58:49.667-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:58:55.066-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:58:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:59:01.941-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:59:01.941-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:59:25.252-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:59:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T00:59:26.307-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:59:26.307-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:59:32.658-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T00:59:32.658-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T00:59:55.623-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 00:59:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:00:09.554-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d84e99527cdec667c13b0 2017-01-29T01:00:10.284-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:00:16.556-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d84f09527cdec667c13b1 2017-01-29T01:00:17.261-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:00:25.875-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:00:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:00:56.160-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:00:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:01:18.112-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:01:18.112-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:01:24.308-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:01:24.308-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:01:26.355-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:01:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:01:30.647-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d853a9527cdec667c13b4 2017-01-29T01:01:31.347-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:01:56.627-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:01:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:02:01.999-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d85599527cdec667c13b5 2017-01-29T01:02:02.772-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:02:21.585-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d856d9527cdec667c13b6 2017-01-29T01:02:22.320-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:02:26.927-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:02:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:02:28.732-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d85749527cdec667c13b7 2017-01-29T01:02:29.651-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:02:57.197-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:02:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:03:00.178-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:03:00.179-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:03:12.555-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d85a09527cdec667c13b9 2017-01-29T01:03:13.216-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:03:19.562-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d85a79527cdec667c13ba 2017-01-29T01:03:20.338-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:03:27.500-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:03:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:03:32.244-0500 [conn1902] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T01:03:56.956-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:03:56.956-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:03:57.847-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:03:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:04:21.502-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d85e59527cdec667c13bc 2017-01-29T01:04:22.289-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:04:28.117-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:04:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:04:34.561-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588d85f1991bf99aafa62145') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485669874426), why: "doing balance round", ts: ObjectId('588d85f29527cdec667c13bd') } } gle1: { lastOp: Timestamp 1485669862000|10, connectionId: 21778, updatedExisting: false, n: 0, syncMillis: 34, writtenTo: null, err: null, waited: 34, ok: 1.0 } gle2: { lastOp: Timestamp 1485669874000|20, connectionId: 393608, updatedExisting: true, n: 1, syncMillis: 27, writtenTo: null, err: null, waited: 27, ok: 1.0 } 2017-01-29T01:04:34.571-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-29T01:04:34.705-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d85f29527cdec667c13bd 2017-01-29T01:04:35.404-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:04:41.753-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d85f99527cdec667c13be 2017-01-29T01:04:42.538-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:04:58.309-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:04:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:05:00.909-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:05:00.909-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:05:25.334-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588d8624d4047e5852d03756') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485669925184), why: "doing balance round", ts: ObjectId('588d86259527cdec667c13c0') } } gle1: { lastOp: Timestamp 1485669925000|11, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 7, writtenTo: null, err: null, waited: 7, ok: 1.0 } gle2: { lastOp: Timestamp 1485669882000|19, connectionId: 393608, updatedExisting: false, n: 0, syncMillis: 26, writtenTo: null, err: null, waited: 26, ok: 1.0 } 2017-01-29T01:05:25.343-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-29T01:05:25.513-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d86259527cdec667c13c0 2017-01-29T01:05:26.255-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:05:28.587-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:05:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:05:38.567-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:05:38.568-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:05:58.823-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:05:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:06:29.036-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:06:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:06:39.424-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:06:39.424-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:06:45.672-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:06:45.672-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:06:59.322-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:06:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:07:16.238-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:07:16.238-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:07:29.602-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:07:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:07:46.688-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:07:46.688-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:07:58.971-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:07:58.971-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:07:59.817-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:07:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:08:11.311-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:08:11.311-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:08:30.153-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:08:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:08:32.252-0500 [conn1903] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T01:08:41.972-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:08:41.972-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:08:48.180-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588d86ef62e531ebd966d132') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485670128057), why: "doing balance round", ts: ObjectId('588d86f09527cdec667c13c9') } } gle1: { lastOp: Timestamp 1485669926000|10, connectionId: 21778, updatedExisting: false, n: 0, syncMillis: 30, writtenTo: null, err: null, waited: 30, ok: 1.0 } gle2: { lastOp: Timestamp 1485670128000|5, connectionId: 6379656, updatedExisting: true, n: 1, syncMillis: 13, writtenTo: null, err: null, waited: 13, ok: 1.0 } 2017-01-29T01:08:48.186-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-29T01:08:48.186-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:08:54.367-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588d86f52cf29185e4b13a3e') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485670134245), why: "doing balance round", ts: ObjectId('588d86f69527cdec667c13ca') } } gle1: { lastOp: Timestamp 1485670134000|9, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 34, writtenTo: null, err: null, waited: 34, ok: 1.0 } gle2: { lastOp: Timestamp 1485670128000|5, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 3, writtenTo: null, err: null, waited: 3, ok: 1.0 } 2017-01-29T01:08:54.373-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-29T01:08:54.373-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:09:00.473-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:09:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:09:00.473-0500 [LockPinger] trying to delete 2 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-29T01:09:00.585-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:09:00.585-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:09:00.619-0500 [LockPinger] handled late remove of old distributed lock with ts 588d86f09527cdec667c13c9 2017-01-29T01:09:00.831-0500 [LockPinger] handled late remove of old distributed lock with ts 588d86f69527cdec667c13ca 2017-01-29T01:09:06.784-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588d8701f2b51e02a6362c6f') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485670146641), why: "doing balance round", ts: ObjectId('588d87029527cdec667c13cc') } } gle1: { lastOp: Timestamp 1485670146000|21, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 33, writtenTo: null, err: null, waited: 33, ok: 1.0 } gle2: { lastOp: Timestamp 1485669926000|9, connectionId: 393608, updatedExisting: false, n: 0, syncMillis: 7, writtenTo: null, err: null, waited: 7, ok: 1.0 } 2017-01-29T01:09:06.793-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-29T01:09:06.929-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d87029527cdec667c13cc 2017-01-29T01:09:07.563-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:09:20.086-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d870f9527cdec667c13cd 2017-01-29T01:09:20.830-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:09:27.045-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d87169527cdec667c13ce 2017-01-29T01:09:27.645-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:09:31.041-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:09:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:09:46.185-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d87299527cdec667c13cf 2017-01-29T01:09:46.884-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:10:01.315-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:10:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:10:17.538-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d87499527cdec667c13d0 2017-01-29T01:10:18.381-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:10:31.467-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:10:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:10:36.856-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d875c9527cdec667c13d1 2017-01-29T01:10:37.455-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:11:01.775-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:11:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:11:08.124-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:11:08.124-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:11:20.399-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:11:20.399-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:11:32.187-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:11:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:11:45.014-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:11:45.014-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:12:02.504-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:12:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:12:32.783-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:12:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:12:58.149-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:12:58.150-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:13:03.106-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:13:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:13:04.502-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d87f09527cdec667c13d6 2017-01-29T01:13:05.280-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:13:32.157-0500 [conn1904] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T01:13:33.467-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:13:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:14:03.654-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:14:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:14:05.994-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588d882d89b67e1cf674cc06') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485670445915), why: "doing balance round", ts: ObjectId('588d882d9527cdec667c13d7') } } gle1: { lastOp: Timestamp 1485670445000|41, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 1, writtenTo: null, err: null, waited: 1, ok: 1.0 } gle2: { lastOp: Timestamp 1485670385000|9, connectionId: 393608, updatedExisting: false, n: 0, syncMillis: 16, writtenTo: null, err: null, waited: 16, ok: 1.0 } 2017-01-29T01:14:06.004-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-29T01:14:06.140-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d882d9527cdec667c13d7 2017-01-29T01:14:06.916-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:14:33.948-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:14:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:14:49.622-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d88599527cdec667c13d8 2017-01-29T01:14:50.279-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:15:02.550-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:15:02.550-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:15:04.256-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:15:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:15:08.750-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:15:08.750-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:15:21.029-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588d8877506bb6f3d3f4d8df') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485670520879), why: "doing balance round", ts: ObjectId('588d88789527cdec667c13db') } } gle1: { lastOp: Timestamp 1485670520000|17, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 8, writtenTo: null, err: null, waited: 8, ok: 1.0 } gle2: { lastOp: Timestamp 1485670490000|11, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 22, writtenTo: null, err: null, waited: 22, ok: 1.0 } 2017-01-29T01:15:21.168-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-29T01:15:21.168-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:15:34.545-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:15:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:15:34.545-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-29T01:15:34.684-0500 [LockPinger] handled late remove of old distributed lock with ts 588d88789527cdec667c13db 2017-01-29T01:16:04.945-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:16:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:16:35.126-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:16:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:16:46.440-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d88ce9527cdec667c13dc 2017-01-29T01:16:47.040-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:17:05.401-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:17:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:17:11.653-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d88e79527cdec667c13dd 2017-01-29T01:17:12.227-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:17:35.723-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:17:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:18:05.972-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:18:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:18:13.103-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d89249527cdec667c13de 2017-01-29T01:18:13.978-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:18:32.420-0500 [conn1905] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T01:18:32.465-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d89389527cdec667c13df 2017-01-29T01:18:33.274-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:18:36.213-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:18:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:19:06.600-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:19:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:19:36.994-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:19:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:20:07.249-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:20:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:20:10.703-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:20:10.703-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:20:37.512-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:20:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:21:07.871-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:21:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:21:29.883-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d89e99527cdec667c13e1 2017-01-29T01:21:30.621-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:21:38.310-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:21:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:22:01.173-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:22:01.173-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:22:07.319-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:22:07.319-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:22:08.600-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:22:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:22:25.788-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d8a219527cdec667c13e4 2017-01-29T01:22:26.500-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:22:38.889-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:22:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:23:09.107-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:23:09.107-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:23:09.177-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:23:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:23:32.356-0500 [conn1906] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T01:23:39.539-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:23:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:24:09.869-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:24:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:24:40.153-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:24:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:25:10.446-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:25:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:25:40.735-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:25:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:26:11.060-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:26:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:26:23.992-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:26:23.992-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:26:41.386-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:26:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:27:11.634-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:27:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:27:18.879-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588d8b45f2367042e84ec850') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485671238758), why: "doing balance round", ts: ObjectId('588d8b469527cdec667c13e7') } } gle1: { lastOp: Timestamp 1485670946000|18, connectionId: 21778, updatedExisting: false, n: 0, syncMillis: 29, writtenTo: null, err: null, waited: 29, ok: 1.0 } gle2: { lastOp: Timestamp 1485671238000|20, connectionId: 6379656, updatedExisting: true, n: 1, syncMillis: 10, writtenTo: null, err: null, waited: 10, ok: 1.0 } 2017-01-29T01:27:18.890-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-29T01:27:19.028-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d8b469527cdec667c13e7 2017-01-29T01:27:19.723-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:27:41.921-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:27:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:28:12.170-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:28:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:28:20.522-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:28:20.522-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:28:32.392-0500 [conn1907] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T01:28:33.095-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d8b909527cdec667c13e9 2017-01-29T01:28:33.837-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:28:42.487-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:28:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:29:12.746-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:29:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:29:43.064-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:29:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:29:52.888-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:29:52.888-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:30:11.527-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d8bf39527cdec667c13eb 2017-01-29T01:30:12.231-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:30:13.258-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:30:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:30:18.563-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d8bfa9527cdec667c13ec 2017-01-29T01:30:19.200-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:30:43.545-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:30:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:31:13.693-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:31:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:31:20.197-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:31:20.197-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:31:44.114-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:31:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:31:44.694-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:31:44.694-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:32:03.241-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d8c629527cdec667c13ef 2017-01-29T01:32:03.932-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:32:14.425-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:32:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:32:40.640-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d8c889527cdec667c13f0 2017-01-29T01:32:41.460-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:32:44.769-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:32:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:33:15.035-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:33:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:33:32.274-0500 [conn1908] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T01:33:45.337-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:33:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:34:12.763-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:34:12.763-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:34:15.508-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:34:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:34:45.666-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:34:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:35:15.938-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:35:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:35:44.179-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:35:44.179-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:35:46.158-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:35:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:36:16.441-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:36:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:36:26.801-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:36:26.801-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:36:46.732-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:36:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:37:09.480-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:37:09.480-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:37:17.055-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:37:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:37:47.404-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:37:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:37:58.153-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:37:58.153-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:38:10.420-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:38:10.420-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:38:17.702-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:38:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:38:22.687-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:38:22.687-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:38:32.220-0500 [conn1909] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T01:38:47.974-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:38:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:38:59.453-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:38:59.453-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:39:18.310-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:39:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:39:36.021-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:39:36.022-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:39:48.576-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:39:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:40:18.892-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:40:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:40:49.177-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:40:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:41:19.446-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:41:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:41:49.708-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:41:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:41:56.127-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d8eb39527cdec667c13fa 2017-01-29T01:41:56.729-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:42:19.942-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:42:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:42:50.093-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:42:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:43:15.939-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:43:15.939-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:43:20.500-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:43:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:43:22.161-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:43:22.161-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:43:32.139-0500 [conn1910] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T01:43:34.419-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:43:34.419-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:43:50.915-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:43:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:44:21.219-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:44:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:44:41.410-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:44:41.410-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:44:51.365-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:44:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:45:12.038-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d8f779527cdec667c13ff 2017-01-29T01:45:12.747-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:45:21.640-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:45:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:45:43.287-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:45:43.287-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:45:51.993-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:45:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:45:55.721-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d8fa39527cdec667c1401 2017-01-29T01:45:56.427-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:46:02.752-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d8faa9527cdec667c1402 2017-01-29T01:46:03.424-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:46:22.295-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:46:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:46:34.052-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d8fc99527cdec667c1403 2017-01-29T01:46:34.762-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:46:52.586-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:46:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:46:53.242-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d8fdc9527cdec667c1404 2017-01-29T01:46:53.872-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:47:06.152-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:47:06.152-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:47:22.812-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:47:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:47:24.611-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:47:24.612-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:47:49.106-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:47:49.106-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:47:53.091-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:47:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:48:23.422-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:48:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:48:32.185-0500 [conn1911] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T01:48:53.701-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:48:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:49:08.105-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:49:08.105-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:49:23.855-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:49:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:49:38.585-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d90829527cdec667c1409 2017-01-29T01:49:39.388-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:49:54.147-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:49:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:50:03.980-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d909b9527cdec667c140a 2017-01-29T01:50:04.613-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:50:11.030-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d90a29527cdec667c140b 2017-01-29T01:50:11.697-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:50:24.441-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:50:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:50:30.049-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:50:30.049-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:50:54.738-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:50:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:51:25.002-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:51:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:51:43.131-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:51:43.131-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:51:55.296-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:51:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:52:19.744-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:52:19.744-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:52:25.459-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:52:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:52:55.723-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:52:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:53:20.641-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:53:20.641-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:53:26.070-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:53:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:53:26.963-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588d916545ec1b68d32624f3') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485672806704), why: "doing balance round", ts: ObjectId('588d91669527cdec667c1410') } } gle1: { lastOp: Timestamp 1485672806000|27, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 31, writtenTo: null, err: null, waited: 31, ok: 1.0 } gle2: { lastOp: Timestamp 1485672611000|10, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 29, writtenTo: null, err: null, waited: 29, ok: 1.0 } 2017-01-29T01:53:26.970-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-29T01:53:26.970-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:53:32.255-0500 [conn1912] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T01:53:33.331-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d916d9527cdec667c1411 2017-01-29T01:53:34.099-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:53:46.509-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d917a9527cdec667c1412 2017-01-29T01:53:47.288-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:53:56.377-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:53:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:53:56.377-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-29T01:53:56.519-0500 [LockPinger] handled late remove of old distributed lock with ts 588d91669527cdec667c1410 2017-01-29T01:53:59.531-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:53:59.531-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:54:26.767-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:54:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:54:57.047-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:54:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:55:24.756-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:55:24.756-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:55:27.326-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:55:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:55:37.031-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588d91e7c9beabcac85e98d4') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485672936875), why: "doing balance round", ts: ObjectId('588d91e89527cdec667c1415') } } gle1: { lastOp: Timestamp 1485672936000|31, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 14, writtenTo: null, err: null, waited: 14, ok: 1.0 } gle2: { lastOp: Timestamp 1485672827000|8, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 26, writtenTo: null, err: null, waited: 26, ok: 1.0 } 2017-01-29T01:55:37.105-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-29T01:55:37.250-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d91e89527cdec667c1415 2017-01-29T01:55:37.886-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:55:50.274-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:55:50.274-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:55:56.610-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d91fc9527cdec667c1417 2017-01-29T01:55:57.313-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:55:57.638-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:55:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:56:03.682-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d92039527cdec667c1418 2017-01-29T01:56:04.419-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:56:22.877-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d92169527cdec667c1419 2017-01-29T01:56:23.763-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:56:27.898-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:56:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:56:36.182-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d92239527cdec667c141a 2017-01-29T01:56:36.880-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:56:55.293-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d92379527cdec667c141b 2017-01-29T01:56:55.995-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T01:56:58.045-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:56:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:57:28.302-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:57:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:57:58.484-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:57:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:58:21.259-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:58:21.259-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:58:28.760-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:58:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:58:32.241-0500 [conn1913] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T01:58:33.528-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:58:33.528-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:58:39.854-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:58:39.854-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:58:58.991-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:58:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:59:29.286-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:59:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:59:40.812-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-29T01:59:40.812-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-29T01:59:59.292-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588d92ef9527cdec667c1420 2017-01-29T01:59:59.568-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 01:59:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T01:59:59.954-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-29T02:00:29.916-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:00:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:01:00.189-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:00:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:01:30.352-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:01:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:02:00.620-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:02:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:02:30.906-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:02:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:03:01.086-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:03:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:03:31.452-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:03:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:03:32.235-0500 [conn1914] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T02:04:01.729-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:04:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:04:32.014-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:04:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:05:02.371-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:05:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:05:32.643-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:05:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:06:02.971-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:06:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:06:33.265-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:06:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:07:03.406-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:07:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:07:33.603-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:07:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:08:03.989-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:08:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:08:32.245-0500 [conn1915] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T02:08:34.308-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:08:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:09:04.586-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:09:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:09:34.777-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:09:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:10:05.094-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:10:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:10:35.373-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:10:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:11:05.643-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:11:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:11:35.906-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:11:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:12:06.204-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:12:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:12:36.457-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:12:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:13:06.806-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:13:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:13:32.177-0500 [conn1916] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T02:13:36.970-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:13:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:14:07.367-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:14:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:14:37.670-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:14:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:15:07.933-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:15:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:15:38.117-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:15:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:16:08.401-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:16:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:16:38.822-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:16:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:17:09.129-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:17:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:17:39.362-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:17:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:18:09.638-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:18:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:18:32.250-0500 [conn1917] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T02:18:39.789-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:18:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:19:10.071-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:19:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:19:40.374-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:19:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:20:10.652-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:20:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:20:40.844-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:20:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:21:11.082-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:21:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:21:41.441-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:21:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:22:11.765-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:22:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:22:42.059-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:22:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:23:12.359-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:23:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:23:32.159-0500 [conn1918] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T02:23:42.653-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:23:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:24:12.934-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:24:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:24:43.124-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:24:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:25:13.410-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:25:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:25:43.554-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:25:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:26:13.817-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:26:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:26:44.131-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:26:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:27:14.406-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:27:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:27:44.786-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:27:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:28:15.066-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:28:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:28:32.353-0500 [conn1919] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T02:28:45.349-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:28:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:29:15.635-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:29:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:29:45.943-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:29:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:30:16.227-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:30:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:30:46.492-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:30:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:31:16.831-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:31:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:31:47.131-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:31:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:32:17.511-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:32:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:32:47.861-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:32:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:33:18.191-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:33:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:33:32.259-0500 [conn1920] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T02:33:48.487-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:33:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:34:18.787-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:34:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:34:49.058-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:34:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:35:19.466-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:35:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:35:49.745-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:35:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:36:20.006-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:36:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:36:50.271-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:36:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:37:20.530-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:37:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:37:50.697-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:37:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:38:21.021-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:38:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:38:32.364-0500 [conn1921] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T02:38:51.230-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:38:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:39:21.480-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:39:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:39:51.845-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:39:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:40:22.126-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:40:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:40:52.465-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:40:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:41:22.744-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:41:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:41:53.035-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:41:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:42:23.332-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:42:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:42:53.686-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:42:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:43:23.962-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:43:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:43:32.141-0500 [conn1922] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T02:43:54.189-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:43:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:44:24.329-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:44:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:44:54.565-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:44:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:45:24.887-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:45:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:45:55.182-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:45:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:46:25.493-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:46:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:46:55.631-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:46:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:47:25.895-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:47:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:47:56.183-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:47:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:48:26.517-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:48:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:48:32.241-0500 [conn1923] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T02:48:56.797-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:48:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:49:26.983-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:49:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:49:57.187-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:49:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:50:27.394-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:50:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:50:57.678-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:50:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:51:27.939-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:51:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:51:58.223-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:51:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:52:28.502-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:52:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:52:58.698-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:52:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:53:29.035-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:53:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:53:32.387-0500 [conn1924] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T02:53:59.198-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:53:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:54:29.499-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:54:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:54:59.784-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:54:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:55:30.198-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:55:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:56:00.483-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:56:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:56:30.787-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:56:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:57:01.181-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:57:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:57:31.387-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:57:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:58:01.628-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:58:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:58:31.845-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:58:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:58:32.361-0500 [conn1925] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T02:59:02.105-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:59:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T02:59:32.269-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 02:59:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:00:02.561-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:00:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:00:32.813-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:00:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:01:03.083-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:01:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:01:33.412-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:01:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:02:03.703-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:02:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:02:33.983-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:02:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:03:04.316-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:03:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:03:32.295-0500 [conn1926] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T03:03:34.721-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:03:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:04:04.879-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:04:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:04:35.164-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:04:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:05:05.336-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:05:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:05:35.640-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:05:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:06:05.897-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:06:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:06:36.153-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:06:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:07:06.414-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:07:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:07:36.632-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:07:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:08:06.925-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:08:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:08:32.223-0500 [conn1927] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T03:08:37.183-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:08:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:09:07.634-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:09:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:09:37.977-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:09:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:10:08.115-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:10:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:10:38.455-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:10:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:11:08.598-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:11:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:11:38.883-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:11:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:12:09.156-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:12:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:12:39.474-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:12:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:13:09.782-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:13:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:13:32.263-0500 [conn1928] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T03:13:40.011-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:13:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:14:10.188-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:14:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:14:40.478-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:14:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:15:10.747-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:15:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:15:40.945-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:15:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:16:11.296-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:16:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:16:41.528-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:16:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:17:11.811-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:17:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:17:42.005-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:17:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:18:12.200-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:18:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:18:32.400-0500 [conn1929] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T03:18:42.474-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:18:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:19:12.685-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:19:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:19:42.994-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:19:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:20:13.263-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:20:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:20:43.535-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:20:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:21:13.828-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:21:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:21:44.092-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:21:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:22:14.353-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:22:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:22:44.636-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:22:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:23:14.969-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:23:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:23:32.396-0500 [conn1930] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T03:23:45.290-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:23:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:24:15.571-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:24:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:24:45.729-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:24:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:25:16.022-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:25:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:25:46.164-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:25:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:26:16.509-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:26:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:26:46.783-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:26:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:27:17.086-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:27:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:27:47.281-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:27:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:28:17.475-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:28:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:28:32.291-0500 [conn1931] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T03:28:47.831-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:28:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:29:18.100-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:29:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:29:48.364-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:29:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:30:18.672-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:30:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:30:48.997-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:30:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:31:19.458-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:31:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:31:49.728-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:31:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:32:19.991-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:32:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:32:50.263-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:32:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:33:20.534-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:33:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:33:32.138-0500 [conn1932] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T03:33:50.783-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:33:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:34:20.971-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:34:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:34:51.231-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:34:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:35:21.527-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:35:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:35:51.807-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:35:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:36:22.000-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:36:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:36:52.212-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:36:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:37:22.539-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:37:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:37:52.821-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:37:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:38:22.990-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:38:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:38:32.286-0500 [conn1933] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T03:38:53.338-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:38:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:39:23.618-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:39:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:39:53.904-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:39:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:40:24.151-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:40:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:40:54.295-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:40:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:41:24.777-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:41:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:41:54.980-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:41:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:42:25.247-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:42:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:42:55.404-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:42:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:43:25.571-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:43:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:43:32.148-0500 [conn1934] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T03:43:55.953-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:43:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:44:26.252-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:44:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:44:56.628-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:44:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:45:26.911-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:45:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:45:57.151-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:45:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:46:27.434-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:46:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:46:57.772-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:46:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:47:28.025-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:47:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:47:58.365-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:47:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:48:28.644-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:48:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:48:32.228-0500 [conn1935] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T03:48:58.933-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:48:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:49:29.189-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:49:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:49:59.487-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:49:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:50:29.660-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:50:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:50:59.839-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:50:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:51:30.002-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:51:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:52:00.198-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:52:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:52:30.509-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:52:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:53:00.798-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:53:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:53:31.060-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:53:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:53:32.150-0500 [conn1936] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T03:54:01.229-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:54:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:54:31.377-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:54:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:55:01.718-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:55:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:55:31.927-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:55:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:56:02.214-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:56:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:56:32.494-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:56:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:57:02.792-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:57:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:57:33.057-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:57:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:58:03.333-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:58:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:58:32.181-0500 [conn1937] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T03:58:33.559-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:58:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:59:03.903-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:59:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T03:59:34.443-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 03:59:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:00:04.722-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:00:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:00:34.995-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:00:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:01:05.268-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:01:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:01:35.551-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:01:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:02:05.772-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:02:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:02:35.938-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:02:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:03:06.212-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:03:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:03:32.371-0500 [conn1938] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T04:03:36.495-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:03:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:04:06.842-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:04:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:04:37.122-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:04:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:05:07.386-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:05:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:05:37.682-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:05:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:06:08.026-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:06:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:06:38.320-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:06:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:07:08.586-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:07:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:07:38.883-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:07:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:08:09.171-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:08:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:08:32.364-0500 [conn1939] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T04:08:39.332-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:08:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:09:09.549-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:09:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:09:39.817-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:09:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:10:10.071-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:10:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:10:40.353-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:10:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:11:10.641-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:11:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:11:40.911-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:11:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:12:11.126-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:12:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:12:41.409-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:12:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:13:11.767-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:13:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:13:32.180-0500 [conn1940] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T04:13:42.153-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:13:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:14:12.432-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:14:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:14:42.777-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:14:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:15:13.040-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:15:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:15:43.332-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:15:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:16:13.626-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:16:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:16:43.859-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:16:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:17:14.189-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:17:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:17:44.422-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:17:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:18:14.733-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:18:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:18:32.314-0500 [conn1941] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T04:18:45.072-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:18:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:19:15.370-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:19:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:19:45.637-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:19:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:20:15.943-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:20:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:20:46.218-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:20:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:21:16.517-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:21:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:21:46.717-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:21:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:22:17.016-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:22:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:22:47.312-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:22:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:23:17.574-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:23:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:23:32.233-0500 [conn1942] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T04:23:48.031-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:23:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:24:18.329-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:24:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:24:48.559-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:24:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:25:18.837-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:25:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:25:49.195-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:25:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:26:19.449-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:26:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:26:49.708-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:26:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:27:19.895-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:27:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:27:50.248-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:27:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:28:20.536-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:28:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:28:32.620-0500 [conn1943] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T04:28:50.818-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:28:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:29:21.084-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:29:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:29:51.383-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:29:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:30:21.670-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:30:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:30:51.950-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:30:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:31:22.208-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:31:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:31:52.384-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:31:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:32:22.608-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:32:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:32:52.814-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:32:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:33:22.954-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:33:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:33:32.452-0500 [conn1944] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T04:33:53.104-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:33:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:34:23.344-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:34:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:34:53.523-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:34:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:35:23.662-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:35:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:35:53.919-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:35:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:36:24.251-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:36:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:36:54.524-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:36:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:37:24.817-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:37:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:37:55.098-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:37:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:38:25.463-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:38:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:38:32.132-0500 [conn1945] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T04:38:55.741-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:38:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:39:26.010-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:39:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:39:56.285-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:39:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:40:26.665-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:40:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:40:56.937-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:40:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:41:27.127-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:41:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:41:57.412-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:41:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:42:27.694-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:42:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:42:57.970-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:42:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:43:28.239-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:43:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:43:32.279-0500 [conn1946] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T04:43:58.499-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:43:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:44:28.833-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:44:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:44:58.966-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:44:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:45:29.284-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:45:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:45:59.578-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:45:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:46:29.798-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:46:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:47:00.039-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:46:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:47:30.383-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:47:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:48:00.664-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:48:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:48:30.865-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:48:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:48:32.142-0500 [conn1947] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T04:49:01.127-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:49:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:49:31.417-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:49:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:50:01.709-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:50:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:50:31.894-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:50:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:51:02.159-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:51:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:51:32.468-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:51:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:52:02.732-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:52:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:52:32.917-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:52:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:53:03.250-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:53:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:53:32.336-0500 [conn1948] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T04:53:33.737-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:53:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:54:04.006-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:54:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:54:34.385-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:54:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:55:04.600-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:55:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:55:34.873-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:55:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:56:05.203-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:56:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:56:35.607-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:56:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:57:05.972-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:57:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:57:36.236-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:57:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:58:06.537-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:58:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:58:32.318-0500 [conn1949] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T04:58:36.805-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:58:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:59:06.978-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:59:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T04:59:37.357-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 04:59:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:00:07.676-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:00:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:00:37.836-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:00:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:01:08.127-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:01:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:01:38.409-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:01:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:02:08.670-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:02:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:02:38.960-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:02:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:03:09.232-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:03:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:03:32.135-0500 [conn1950] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T05:03:39.562-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:03:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:04:09.756-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:04:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:04:40.038-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:04:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:05:10.310-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:05:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:05:40.475-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:05:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:06:10.694-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:06:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:06:40.957-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:06:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:07:11.248-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:07:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:07:41.597-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:07:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:08:11.794-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:08:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:08:32.175-0500 [conn1951] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T05:08:42.088-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:08:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:09:12.396-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:09:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:09:42.686-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:09:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:10:12.992-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:10:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:10:43.312-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:10:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:11:13.589-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:11:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:11:43.916-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:11:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:12:14.076-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:12:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:12:44.362-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:12:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:13:14.552-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:13:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:13:32.215-0500 [conn1952] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T05:13:44.819-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:13:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:14:15.219-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:14:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:14:45.399-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:14:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:15:15.586-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:15:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:15:45.876-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:15:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:16:16.164-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:16:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:16:46.525-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:16:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:17:16.803-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:17:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:17:47.059-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:17:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:18:17.217-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:18:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:18:32.344-0500 [conn1953] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T05:18:47.497-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:18:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:19:17.659-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:19:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:19:47.949-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:19:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:20:18.218-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:20:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:20:48.376-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:20:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:21:18.641-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:21:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:21:48.963-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:21:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:22:19.225-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:22:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:22:49.382-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:22:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:23:19.643-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:23:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:23:32.340-0500 [conn1954] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T05:23:49.963-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:23:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:24:20.230-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:24:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:24:50.529-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:24:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:25:20.821-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:25:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:25:51.111-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:25:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:26:21.404-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:26:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:26:51.703-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:26:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:27:22.021-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:27:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:27:52.387-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:27:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:28:22.704-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:28:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:28:32.301-0500 [conn1955] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T05:28:52.983-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:28:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:29:23.247-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:29:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:29:53.535-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:29:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:30:23.804-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:30:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:30:54.109-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:30:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:31:24.371-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:31:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:31:54.568-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:31:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:32:24.859-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:32:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:32:54.997-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:32:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:33:25.281-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:33:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:33:32.397-0500 [conn1956] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T05:33:55.616-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:33:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:34:25.891-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:34:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:34:56.164-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:34:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:35:26.327-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:35:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:35:56.514-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:35:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:36:26.696-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:36:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:36:57.052-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:36:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:37:27.322-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:37:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:37:57.605-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:37:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:38:27.860-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:38:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:38:32.257-0500 [conn1957] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T05:38:58.105-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:38:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:39:28.370-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:39:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:39:58.580-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:39:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:40:28.775-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:40:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:40:59.060-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:40:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:41:29.216-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:41:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:41:59.502-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:41:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:42:29.849-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:42:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:43:00.124-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:42:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:43:30.451-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:43:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:43:32.217-0500 [conn1958] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T05:44:00.624-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:44:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:44:30.912-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:44:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:45:01.210-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:45:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:45:31.521-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:45:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:46:01.789-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:46:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:46:32.115-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:46:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:47:02.410-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:47:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:47:32.665-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:47:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:48:02.932-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:48:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:48:32.880-0500 [conn1959] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T05:48:33.106-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:48:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:49:03.524-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:49:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:49:33.805-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:49:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:50:03.963-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:50:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:50:34.124-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:50:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:51:04.404-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:51:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:51:34.649-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:51:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:52:04.793-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:52:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:52:34.971-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:52:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:53:05.233-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:53:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:53:32.305-0500 [conn1960] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T05:53:35.599-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:53:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:54:05.778-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:54:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:54:36.024-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:54:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:55:06.333-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:55:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:55:36.620-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:55:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:56:06.901-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:56:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:56:37.183-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:56:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:57:07.526-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:57:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:57:37.685-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:57:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:58:07.921-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:58:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:58:32.209-0500 [conn1961] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T05:58:38.243-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:58:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:59:09.725-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:59:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T05:59:39.989-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 05:59:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:00:10.140-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:00:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:00:40.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:00:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:01:10.685-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:01:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:01:40.992-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:01:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:02:11.267-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:02:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:02:41.561-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:02:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:03:11.742-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:03:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:03:32.180-0500 [conn1962] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T06:03:41.968-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:03:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:04:12.306-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:04:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:04:42.600-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:04:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:05:12.862-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:05:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:05:43.178-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:05:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:06:13.348-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:06:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:06:43.637-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:06:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:07:13.907-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:07:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:07:44.148-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:07:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:08:14.416-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:08:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:08:32.268-0500 [conn1963] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T06:08:44.591-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:08:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:09:14.896-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:09:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:09:45.064-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:09:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:10:15.396-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:10:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:10:45.626-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:10:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:11:15.960-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:11:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:11:46.339-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:11:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:12:16.596-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:12:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:12:46.873-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:12:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:13:17.147-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:13:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:13:32.179-0500 [conn1964] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T06:13:47.422-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:13:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:14:17.772-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:14:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:14:48.056-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:14:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:15:18.343-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:15:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:15:48.534-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:15:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:16:18.806-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:16:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:16:49.142-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:16:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:17:19.293-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:17:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:17:49.577-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:17:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:18:19.958-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:18:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:18:32.218-0500 [conn1965] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T06:18:50.266-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:18:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:19:20.410-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:19:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:19:50.546-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:19:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:20:20.799-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:20:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:20:51.012-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:20:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:21:21.327-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:21:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:21:51.495-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:21:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:22:21.714-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:22:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:22:51.989-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:22:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:23:22.418-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:23:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:23:32.300-0500 [conn1966] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T06:23:52.700-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:23:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:24:22.981-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:24:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:24:53.250-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:24:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:25:23.525-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:25:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:25:53.802-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:25:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:26:24.182-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:26:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:26:54.444-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:26:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:27:24.614-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:27:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:27:54.911-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:27:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:28:25.178-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:28:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:28:32.137-0500 [conn1967] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T06:28:55.587-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:28:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:29:25.721-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:29:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:29:55.981-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:29:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:30:26.333-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:30:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:30:56.647-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:30:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:31:26.904-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:31:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:31:57.177-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:31:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:32:27.465-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:32:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:32:57.808-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:32:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:33:28.137-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:33:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:33:32.326-0500 [conn1968] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T06:33:58.354-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:33:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:34:28.588-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:34:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:34:58.836-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:34:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:35:29.129-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:35:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:35:59.312-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:35:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:36:29.598-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:36:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:36:59.763-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:36:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:37:30.091-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:37:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:38:00.363-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:38:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:38:30.692-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:38:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:38:32.245-0500 [conn1969] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T06:39:00.992-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:39:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:39:31.325-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:39:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:40:01.582-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:40:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:40:31.854-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:40:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:41:02.038-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:41:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:41:32.238-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:41:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:42:02.571-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:42:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:42:32.857-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:42:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:43:03.059-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:43:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:43:32.481-0500 [conn1970] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T06:43:33.254-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:43:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:44:03.524-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:44:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:44:33.811-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:44:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:45:04.108-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:45:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:45:34.449-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:45:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:46:04.721-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:46:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:46:35.023-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:46:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:47:05.286-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:47:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:47:35.666-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:47:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:48:05.971-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:48:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:48:32.348-0500 [conn1971] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T06:48:36.209-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:48:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:49:06.486-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:49:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:49:36.794-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:49:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:50:06.956-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:50:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:50:37.232-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:50:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:51:07.375-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:51:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:51:37.724-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:51:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:52:08.013-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:52:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:52:38.255-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:52:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:53:08.640-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:53:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:53:32.263-0500 [conn1972] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T06:53:38.899-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:53:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:54:09.288-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:54:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:54:39.613-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:54:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:55:10.053-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:55:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:55:40.227-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:55:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:56:10.411-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:56:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:56:40.707-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:56:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:57:10.850-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:57:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:57:40.997-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:57:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:58:11.291-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:58:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:58:32.360-0500 [conn1973] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T06:58:41.549-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:58:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:59:12.887-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:59:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T06:59:43.178-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 06:59:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:00:13.328-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:00:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:00:43.602-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:00:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:01:13.802-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:01:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:01:44.161-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:01:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:02:14.419-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:02:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:02:44.653-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:02:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:03:14.936-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:03:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:03:32.245-0500 [conn1974] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T07:03:45.206-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:03:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:04:15.467-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:04:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:04:45.822-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:04:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:05:16.106-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:05:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:05:46.366-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:05:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:06:16.549-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:06:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:06:46.874-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:06:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:07:17.090-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:07:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:07:47.371-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:07:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:08:17.701-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:08:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:08:32.793-0500 [conn1975] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T07:08:47.980-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:08:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:09:18.138-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:09:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:09:48.386-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:09:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:10:18.571-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:10:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:10:48.847-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:10:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:11:19.221-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:11:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:11:49.499-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:11:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:12:19.760-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:12:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:12:50.164-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:12:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:13:20.369-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:13:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:13:32.144-0500 [conn1976] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T07:13:50.692-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:13:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:14:20.977-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:14:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:14:51.250-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:14:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:15:21.624-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:15:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:15:51.781-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:15:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:16:22.019-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:16:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:16:52.165-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:16:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:17:22.440-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:17:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:17:52.733-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:17:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:18:23.095-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:18:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:18:32.192-0500 [conn1977] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T07:18:53.549-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:18:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:19:23.818-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:19:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:19:54.087-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:19:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:20:24.367-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:20:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:20:54.591-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:20:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:21:24.918-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:21:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:21:55.167-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:21:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:22:25.445-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:22:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:22:55.722-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:22:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:23:26.010-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:23:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:23:32.111-0500 [conn1978] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T07:23:56.292-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:23:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:24:26.440-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:24:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:24:56.662-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:24:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:25:26.932-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:25:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:25:57.223-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:25:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:26:27.548-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:26:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:26:57.838-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:26:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:27:28.107-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:27:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:27:58.390-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:27:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:28:28.713-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:28:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:28:32.318-0500 [conn1979] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T07:28:58.990-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:28:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:29:29.295-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:29:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:29:59.578-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:29:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:30:29.774-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:30:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:31:00.086-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:30:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:31:30.415-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:31:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:32:00.734-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:32:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:32:31.040-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:32:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:33:01.314-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:33:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:33:31.731-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:33:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:33:32.290-0500 [conn1980] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T07:34:01.999-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:34:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:34:32.353-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:34:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:35:02.492-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:35:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:35:32.801-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:35:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:36:03.087-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:36:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:36:33.389-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:36:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:37:03.817-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:37:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:37:34.094-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:37:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:38:04.232-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:38:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:38:32.298-0500 [conn1981] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T07:38:34.620-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:38:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:39:04.898-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:39:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:39:35.191-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:39:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:40:05.491-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:40:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:40:35.743-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:40:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:41:06.041-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:41:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:41:36.370-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:41:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:42:06.617-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:42:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:42:36.934-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:42:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:43:07.249-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:43:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:43:32.201-0500 [conn1982] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T07:43:37.483-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:43:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:44:07.776-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:44:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:44:37.940-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:44:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:45:08.218-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:45:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:45:38.465-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:45:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:46:08.614-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:46:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:46:38.911-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:46:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:47:09.199-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:47:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:47:39.474-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:47:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:48:09.726-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:48:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:48:32.272-0500 [conn1983] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T07:48:40.010-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:48:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:49:10.317-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:49:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:49:40.552-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:49:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:50:10.746-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:50:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:50:40.938-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:50:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:51:11.236-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:51:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:51:41.388-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:51:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:52:11.546-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:52:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:52:41.910-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:52:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:53:12.064-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:53:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:53:32.363-0500 [conn1984] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T07:53:42.333-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:53:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:54:12.632-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:54:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:54:42.924-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:54:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:55:13.244-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:55:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:55:43.529-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:55:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:56:13.692-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:56:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:56:43.983-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:56:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:57:14.267-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:57:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:57:44.439-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:57:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:58:14.869-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:58:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:58:32.248-0500 [conn1985] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T07:58:45.168-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:58:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:59:15.829-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:59:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T07:59:46.159-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 07:59:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:00:16.414-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:00:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:00:46.711-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:00:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:01:17.054-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:01:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:01:47.343-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:01:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:02:17.673-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:02:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:02:47.954-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:02:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:03:18.290-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:03:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:03:32.314-0500 [conn1986] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T08:03:48.603-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:03:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:04:18.913-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:04:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:04:49.205-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:04:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:05:19.399-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:05:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:05:49.668-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:05:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:06:19.942-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:06:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:06:50.106-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:06:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:07:20.336-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:07:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:07:50.674-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:07:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:08:20.950-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:08:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:08:32.400-0500 [conn1987] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T08:08:51.279-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:08:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:09:21.544-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:09:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:09:51.807-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:09:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:10:21.959-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:10:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:10:52.253-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:10:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:11:22.532-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:11:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:11:52.964-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:11:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:12:23.128-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:12:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:12:53.465-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:12:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:13:23.607-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:13:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:13:32.296-0500 [conn1988] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T08:13:53.857-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:13:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:14:24.121-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:14:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:14:54.372-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:14:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:15:24.666-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:15:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:15:54.963-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:15:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:16:25.251-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:16:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:16:55.573-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:16:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:17:25.830-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:17:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:17:56.125-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:17:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:18:26.426-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:18:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:18:32.301-0500 [conn1989] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T08:18:56.659-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:18:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:19:26.921-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:19:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:19:57.232-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:19:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:20:27.442-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:20:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:20:57.713-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:20:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:21:28.038-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:21:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:21:58.319-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:21:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:22:28.600-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:22:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:22:58.971-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:22:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:23:29.245-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:23:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:23:32.213-0500 [conn1990] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T08:23:59.542-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:23:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:24:29.835-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:24:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:25:00.107-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:24:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:25:30.263-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:25:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:26:00.487-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:26:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:26:30.712-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:26:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:27:00.982-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:27:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:27:31.305-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:27:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:28:01.491-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:28:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:28:31.741-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:28:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:28:32.342-0500 [conn1991] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T08:29:02.009-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:29:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:29:32.451-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:29:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:30:02.693-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:30:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:30:32.904-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:30:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:31:03.160-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:31:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:31:33.443-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:31:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:32:03.598-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:32:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:32:33.870-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:32:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:33:04.017-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:33:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:33:32.158-0500 [conn1992] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T08:33:34.161-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:33:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:34:04.451-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:34:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:34:34.650-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:34:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:35:05.009-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:35:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:35:35.340-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:35:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:36:05.663-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:36:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:36:35.984-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:36:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:37:06.291-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:37:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:37:36.578-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:37:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:38:06.767-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:38:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:38:32.149-0500 [conn1993] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T08:38:37.150-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:38:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:39:07.332-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:39:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:39:37.657-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:39:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:40:07.948-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:40:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:40:38.109-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:40:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:41:08.405-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:41:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:41:38.541-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:41:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:42:08.827-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:42:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:42:39.110-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:42:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:43:09.306-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:43:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:43:32.186-0500 [conn1994] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T08:43:39.552-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:43:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:44:09.836-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:44:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:44:40.105-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:44:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:45:10.349-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:45:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:45:40.739-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:45:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:46:11.030-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:46:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:46:41.374-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:46:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:47:11.636-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:47:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:47:41.924-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:47:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:48:12.200-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:48:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:48:32.324-0500 [conn1995] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T08:48:42.449-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:48:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:49:12.771-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:49:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:49:43.031-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:49:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:50:13.296-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:50:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:50:43.572-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:50:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:51:13.834-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:51:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:51:44.109-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:51:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:52:14.292-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:52:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:52:44.576-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:52:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:53:14.857-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:53:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:53:32.237-0500 [conn1996] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T08:53:45.011-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:53:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:54:15.215-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:54:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:54:45.478-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:54:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:55:15.902-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:55:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:55:46.191-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:55:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:56:16.474-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:56:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:56:46.842-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:56:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:57:17.140-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:57:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:57:47.293-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:57:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:58:17.516-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:58:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:58:32.305-0500 [conn1997] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T08:58:47.668-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:58:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:59:17.916-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:59:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T08:59:48.188-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 08:59:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:00:18.471-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:00:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:00:48.753-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:00:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:01:18.952-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:01:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:01:49.258-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:01:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:02:19.515-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:02:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:02:49.769-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:02:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:03:20.030-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:03:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:03:32.253-0500 [conn1998] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T09:03:50.404-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:03:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:04:20.744-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:04:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:04:50.969-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:04:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:05:21.194-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:05:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:05:51.597-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:05:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:06:21.954-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:06:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:06:52.263-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:06:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:07:22.538-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:07:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:07:52.932-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:07:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:08:23.197-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:08:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:08:32.322-0500 [conn1999] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T09:08:53.529-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:08:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:09:23.827-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:09:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:09:54.134-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:09:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:10:24.421-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:10:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:10:54.685-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:10:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:11:24.947-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:11:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:11:55.324-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:11:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:12:25.654-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:12:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:12:55.906-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:12:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:13:26.251-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:13:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:13:32.277-0500 [conn2000] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T09:13:56.413-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:13:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:14:26.689-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:14:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:14:56.921-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:14:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:15:27.238-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:15:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:15:57.537-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:15:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:16:27.746-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:16:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:16:58.149-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:16:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:17:28.474-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:17:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:17:58.764-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:17:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:18:28.951-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:18:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:18:32.168-0500 [conn2001] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T09:18:59.151-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:18:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:19:29.453-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:19:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:19:59.784-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:19:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:20:29.975-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:20:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:21:00.372-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:20:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:21:30.633-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:21:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:22:00.891-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:22:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:22:31.144-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:22:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:23:01.429-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:23:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:23:31.711-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:23:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:23:32.278-0500 [conn2002] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T09:24:01.946-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:24:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:24:32.280-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:24:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:25:02.569-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:25:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:25:32.955-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:25:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:26:03.248-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:26:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:26:33.538-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:26:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:27:03.725-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:27:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:27:33.910-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:27:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:28:04.150-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:28:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:28:32.361-0500 [conn2003] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T09:28:34.429-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:28:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:29:04.727-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:29:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:29:34.968-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:29:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:30:05.185-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:30:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:30:35.519-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:30:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:31:05.875-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:31:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:31:36.193-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:31:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:32:06.479-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:32:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:32:36.790-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:32:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:33:07.071-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:33:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:33:32.332-0500 [conn2004] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T09:33:37.261-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:33:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:34:07.600-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:34:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:34:37.988-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:34:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:35:08.235-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:35:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:35:38.542-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:35:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:36:08.761-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:36:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:36:39.025-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:36:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:37:09.310-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:37:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:37:39.561-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:37:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:38:09.799-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:38:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:38:32.177-0500 [conn2005] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T09:38:39.972-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:38:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:39:10.270-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:39:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:39:40.563-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:39:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:40:10.846-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:40:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:40:41.094-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:40:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:41:11.284-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:41:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:41:41.461-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:41:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:42:11.759-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:42:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:42:42.338-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:42:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:43:12.589-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:43:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:43:32.253-0500 [conn2006] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T09:43:42.952-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:43:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:44:13.100-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:44:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:44:43.324-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:44:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:45:13.651-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:45:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:45:43.892-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:45:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:46:14.186-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:46:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:46:44.358-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:46:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:47:14.529-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:47:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:47:44.791-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:47:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:48:15.075-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:48:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:48:32.212-0500 [conn2007] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T09:48:45.343-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:48:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:49:15.566-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:49:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:49:45.804-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:49:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:50:16.147-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:50:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:50:46.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:50:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:51:16.714-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:51:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:51:47.031-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:51:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:52:17.434-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:52:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:52:47.710-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:52:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:53:17.984-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:53:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:53:32.297-0500 [conn2008] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T09:53:48.328-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:53:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:54:18.600-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:54:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:54:48.932-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:54:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:55:19.196-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:55:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:55:49.439-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:55:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:56:19.747-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:56:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:56:50.008-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:56:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:57:20.313-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:57:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:57:50.573-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:57:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:58:20.854-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:58:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:58:32.258-0500 [conn2009] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T09:58:51.130-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:58:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:59:21.477-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:59:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T09:59:51.735-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 09:59:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:00:21.903-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:00:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:00:52.214-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:00:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:01:22.378-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:01:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:01:52.622-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:01:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:02:22.800-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:02:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:02:53.043-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:02:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:03:23.606-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:03:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:03:32.371-0500 [conn2010] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T10:03:53.847-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:03:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:04:24.165-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:04:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:04:54.401-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:04:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:05:24.817-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:05:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:05:55.098-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:05:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:06:25.408-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:06:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:06:55.797-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:06:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:07:26.187-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:07:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:07:56.479-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:07:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:08:26.702-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:08:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:08:32.326-0500 [conn2011] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T10:08:57.013-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:08:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:09:27.280-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:09:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:09:57.588-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:09:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:10:27.851-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:10:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:10:58.132-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:10:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:11:28.395-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:11:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:11:58.700-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:11:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:12:29.081-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:12:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:12:59.459-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:12:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:13:29.761-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:13:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:13:32.332-0500 [conn2012] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T10:14:00.077-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:13:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:14:30.331-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:14:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:15:00.609-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:15:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:15:30.913-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:15:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:16:01.225-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:16:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:16:31.506-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:16:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:17:01.674-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:17:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:17:32.056-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:17:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:18:02.340-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:18:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:18:32.252-0500 [conn2013] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T10:18:32.692-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:18:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:19:03.051-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:19:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:19:33.319-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:19:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:20:03.705-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:20:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:20:33.951-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:20:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:21:04.215-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:21:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:21:34.488-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:21:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:22:04.828-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:22:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:22:35.118-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:22:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:23:05.642-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:23:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:23:32.418-0500 [conn2014] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T10:23:36.003-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:23:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:24:06.453-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:24:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:24:36.793-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:24:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:25:07.072-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:25:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:25:37.343-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:25:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:26:07.547-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:26:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:26:37.911-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:26:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:27:08.207-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:27:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:27:38.481-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:27:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:28:08.682-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:28:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:28:32.309-0500 [conn2015] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T10:28:38.982-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:28:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:29:09.216-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:29:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:29:39.458-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:29:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:30:09.708-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:30:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:30:40.070-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:30:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:31:10.344-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:31:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:31:40.624-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:31:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:32:10.929-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:32:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:32:41.217-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:32:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:33:11.592-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:33:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:33:32.331-0500 [conn2016] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T10:33:41.860-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:33:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:34:12.194-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:34:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:34:42.491-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:34:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:35:12.703-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:35:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:35:42.953-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:35:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:36:13.329-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:36:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:36:43.648-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:36:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:37:13.992-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:37:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:37:44.260-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:37:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:38:14.597-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:38:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:38:32.333-0500 [conn2017] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T10:38:44.815-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:38:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:39:15.111-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:39:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:39:45.372-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:39:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:40:15.588-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:40:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:40:45.874-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:40:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:41:16.250-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:41:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:41:46.511-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:41:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:42:16.726-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:42:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:42:47.206-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:42:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:43:17.537-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:43:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:43:32.201-0500 [conn2018] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T10:43:47.877-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:43:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:44:18.125-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:44:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:44:48.405-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:44:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:45:18.681-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:45:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:45:48.951-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:45:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:46:19.134-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:46:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:46:49.383-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:46:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:47:19.683-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:47:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:47:49.932-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:47:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:48:20.195-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:48:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:48:32.366-0500 [conn2019] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T10:48:50.454-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:48:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:49:20.791-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:49:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:49:51.080-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:49:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:50:21.346-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:50:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:50:51.574-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:50:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:51:21.892-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:51:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:51:52.207-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:51:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:52:22.465-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:52:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:52:52.746-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:52:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:53:22.973-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:53:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:53:32.214-0500 [conn2020] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T10:53:53.409-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:53:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:54:23.779-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:54:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:54:54.046-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:54:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:55:24.400-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:55:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:55:54.657-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:55:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:56:24.972-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:56:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:56:55.383-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:56:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:57:25.716-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:57:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:57:55.950-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:57:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:58:26.222-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:58:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:58:32.390-0500 [conn2021] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T10:58:56.502-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:58:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:59:26.773-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:59:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T10:59:57.042-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 10:59:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:00:27.224-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:00:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:00:57.501-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:00:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:01:27.830-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:01:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:01:58.209-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:01:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:02:28.631-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:02:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:02:58.901-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:02:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:03:29.378-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:03:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:03:32.326-0500 [conn2022] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T11:03:59.647-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:03:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:04:29.915-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:04:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:05:00.151-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:04:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:05:30.489-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:05:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:06:00.727-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:06:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:06:31.037-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:06:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:07:01.320-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:07:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:07:31.602-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:07:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:08:01.870-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:08:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:08:32.180-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:08:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:08:32.335-0500 [conn2023] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T11:09:02.470-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:09:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:09:32.943-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:09:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:10:03.240-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:10:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:10:33.460-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:10:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:11:03.760-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:11:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:11:34.106-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:11:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:12:04.420-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:12:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:12:34.698-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:12:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:13:05.041-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:13:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:13:32.304-0500 [conn2024] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T11:13:35.316-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:13:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:14:05.608-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:14:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:14:35.806-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:14:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:15:05.981-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:15:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:15:36.319-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:15:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:16:06.602-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:16:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:16:36.761-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:16:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:17:07.065-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:17:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:17:37.233-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:17:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:18:07.581-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:18:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:18:32.161-0500 [conn2025] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T11:18:37.868-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:18:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:19:08.184-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:19:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:19:38.371-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:19:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:20:08.636-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:20:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:20:38.827-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:20:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:21:09.116-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:21:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:21:39.454-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:21:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:22:09.830-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:22:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:22:40.131-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:22:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:23:10.314-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:23:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:23:32.213-0500 [conn2026] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T11:23:40.588-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:23:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:24:10.962-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:24:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:24:41.229-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:24:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:25:11.494-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:25:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:25:41.862-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:25:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:26:12.381-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:26:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:26:42.569-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:26:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:27:12.868-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:27:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:27:43.284-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:27:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:28:13.620-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:28:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:28:32.353-0500 [conn2027] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T11:28:43.782-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:28:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:29:14.070-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:29:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:29:44.219-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:29:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:30:14.480-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:30:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:30:44.764-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:30:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:31:15.068-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:31:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:31:45.237-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:31:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:32:15.504-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:32:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:32:45.831-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:32:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:33:16.104-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:33:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:33:32.354-0500 [conn2028] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T11:33:46.303-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:33:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:34:16.723-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:34:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:34:47.069-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:34:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:35:17.318-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:35:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:35:47.469-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:35:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:36:17.807-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:36:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:36:48.150-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:36:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:37:18.332-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:37:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:37:48.467-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:37:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:38:18.661-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:38:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:38:32.252-0500 [conn2029] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T11:38:48.934-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:38:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:39:19.122-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:39:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:39:49.431-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:39:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:40:19.621-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:40:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:40:49.919-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:40:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:41:20.190-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:41:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:41:50.505-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:41:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:42:20.695-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:42:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:42:50.842-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:42:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:43:21.116-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:43:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:43:32.243-0500 [conn2030] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T11:43:51.373-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:43:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:44:21.627-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:44:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:44:51.877-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:44:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:45:22.139-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:45:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:45:52.434-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:45:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:46:22.623-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:46:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:46:52.915-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:46:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:47:23.172-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:47:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:47:53.315-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:47:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:48:23.640-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:48:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:48:32.309-0500 [conn2031] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T11:48:53.876-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:48:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:49:24.169-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:49:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:49:54.468-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:49:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:50:24.723-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:50:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:50:55.053-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:50:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:51:25.312-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:51:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:51:55.643-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:51:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:52:25.823-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:52:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:52:56.128-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:52:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:53:26.293-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:53:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:53:32.258-0500 [conn2032] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T11:53:56.486-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:53:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:54:26.759-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:54:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:54:57.050-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:54:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:55:27.194-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:55:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:55:57.495-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:55:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:56:27.818-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:56:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:56:58.175-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:56:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:57:28.599-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:57:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:57:58.771-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:57:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:58:28.980-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:58:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:58:32.282-0500 [conn2033] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T11:58:59.242-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:58:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:59:29.523-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:59:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T11:59:59.721-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 11:59:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:00:29.998-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:00:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:01:00.269-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:00:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:01:30.467-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:01:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:02:00.756-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:02:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:02:31.015-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:02:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:03:01.271-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:03:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:03:31.587-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:03:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:03:32.151-0500 [conn2034] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T12:04:01.846-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:04:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:04:32.124-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:04:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:05:02.404-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:05:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:05:32.619-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:05:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:06:02.896-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:06:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:06:33.155-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:06:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:07:03.443-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:07:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:07:33.733-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:07:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:08:04.000-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:08:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:08:32.240-0500 [conn2035] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T12:08:34.265-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:08:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:09:04.631-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:09:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:09:34.912-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:09:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:10:05.206-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:10:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:10:35.356-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:10:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:11:05.686-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:11:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:11:35.818-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:11:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:12:06.072-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:12:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:12:36.505-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:12:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:13:06.744-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:13:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:13:32.203-0500 [conn2036] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T12:13:37.017-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:13:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:14:07.170-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:14:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:14:37.512-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:14:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:15:07.696-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:15:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:15:37.889-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:15:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:16:08.188-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:16:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:16:38.466-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:16:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:17:08.806-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:17:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:17:39.074-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:17:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:18:09.258-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:18:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:18:32.152-0500 [conn2037] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T12:18:39.533-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:18:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:19:09.825-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:19:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:19:40.116-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:19:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:20:10.335-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:20:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:20:40.645-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:20:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:21:10.887-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:21:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:21:41.155-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:21:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:22:11.475-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:22:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:22:41.642-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:22:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:23:11.908-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:23:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:23:32.201-0500 [conn2038] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T12:23:42.217-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:23:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:24:12.687-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:24:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:24:42.913-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:24:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:25:13.249-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:25:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:25:43.555-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:25:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:26:13.704-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:26:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:26:44.016-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:26:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:27:14.311-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:27:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:27:44.612-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:27:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:28:14.923-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:28:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:28:32.393-0500 [conn2039] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T12:28:45.197-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:28:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:29:15.477-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:29:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:29:45.821-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:29:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:30:16.101-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:30:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:30:46.416-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:30:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:31:16.730-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:31:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:31:47.000-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:31:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:32:17.299-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:32:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:32:47.582-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:32:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:33:17.736-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:33:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:33:32.173-0500 [conn2040] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T12:33:48.008-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:33:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:34:18.284-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:34:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:34:48.589-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:34:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:35:18.866-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:35:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:35:49.127-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:35:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:36:19.383-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:36:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:36:49.649-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:36:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:37:19.946-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:37:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:37:50.100-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:37:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:38:20.417-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:38:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:38:32.367-0500 [conn2041] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T12:38:50.686-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:38:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:39:20.871-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:39:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:39:51.124-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:39:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:40:21.278-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:40:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:40:51.546-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:40:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:41:21.846-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:41:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:41:52.116-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:41:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:42:22.397-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:42:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:42:52.665-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:42:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:43:22.976-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:43:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:43:32.290-0500 [conn2042] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T12:43:53.201-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:43:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:44:23.470-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:44:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:44:53.762-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:44:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:45:24.040-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:45:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:45:54.325-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:45:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:46:24.619-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:46:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:46:54.878-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:46:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:47:25.042-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:47:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:47:55.276-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:47:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:48:25.438-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:48:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:48:32.334-0500 [conn2043] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T12:48:55.580-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:48:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:49:25.986-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:49:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:49:56.130-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:49:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:50:26.408-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:50:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:50:56.636-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:50:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:51:27.014-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:51:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:51:57.286-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:51:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:52:27.601-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:52:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:52:58.002-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:52:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:53:28.226-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:53:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:53:32.570-0500 [conn2044] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T12:53:58.423-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:53:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:54:28.748-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:54:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:54:59.073-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:54:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:55:29.522-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:55:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:55:59.709-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:55:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:56:29.987-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:56:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:57:00.246-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:56:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:57:30.536-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:57:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:58:00.760-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:58:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:58:31.044-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:58:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:58:32.140-0500 [conn2045] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T12:59:01.395-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:59:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T12:59:31.801-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 12:59:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:00:02.100-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:00:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:00:32.518-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:00:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:01:02.868-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:01:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:01:33.193-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:01:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:02:03.603-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:02:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:02:33.879-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:02:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:03:04.015-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:03:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:03:32.251-0500 [conn2046] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T13:03:34.302-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:03:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:04:04.505-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:04:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:04:34.752-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:04:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:05:05.040-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:05:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:05:35.324-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:05:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:06:05.658-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:06:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:06:35.933-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:06:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:07:06.202-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:07:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:07:36.476-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:07:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:08:06.756-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:08:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:08:32.307-0500 [conn2047] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T13:08:37.034-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:08:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:09:07.312-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:09:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:09:37.596-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:09:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:10:07.831-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:10:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:10:38.099-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:10:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:11:08.438-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:11:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:11:38.821-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:11:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:12:09.077-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:12:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:12:39.334-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:12:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:13:09.484-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:13:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:13:32.221-0500 [conn2048] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T13:13:39.827-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:13:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:14:10.180-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:14:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:14:40.462-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:14:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:15:10.728-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:15:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:15:41.039-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:15:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:16:11.391-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:16:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:16:41.583-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:16:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:17:11.869-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:17:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:17:42.131-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:17:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:18:12.308-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:18:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:18:32.314-0500 [conn2049] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T13:18:42.588-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:18:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:19:12.776-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:19:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:19:43.013-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:19:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:20:13.360-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:20:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:20:43.689-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:20:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:21:13.976-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:21:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:21:44.149-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:21:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:22:14.439-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:22:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:22:44.676-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:22:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:23:14.843-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:23:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:23:32.360-0500 [conn2050] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T13:23:45.161-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:23:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:24:15.454-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:24:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:24:45.826-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:24:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:25:15.985-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:25:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:25:46.230-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:25:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:26:16.547-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:26:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:26:46.851-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:26:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:27:17.127-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:27:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:27:47.387-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:27:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:28:17.660-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:28:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:28:32.173-0500 [conn2051] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T13:28:47.849-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:28:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:29:18.059-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:29:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:29:48.324-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:29:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:30:18.488-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:30:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:30:48.779-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:30:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:31:19.051-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:31:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:31:49.290-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:31:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:32:19.495-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:32:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:32:49.877-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:32:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:33:20.121-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:33:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:33:32.136-0500 [conn2052] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T13:33:50.424-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:33:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:34:20.703-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:34:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:34:50.913-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:34:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:35:21.204-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:35:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:35:51.512-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:35:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:36:21.885-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:36:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:36:52.227-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:36:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:37:22.498-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:37:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:37:52.801-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:37:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:38:23.242-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:38:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:38:32.236-0500 [conn2053] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T13:38:53.534-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:38:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:39:23.797-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:39:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:39:54.082-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:39:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:40:24.449-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:40:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:40:54.733-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:40:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:41:25.014-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:41:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:41:55.297-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:41:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:42:25.564-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:42:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:42:55.826-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:42:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:43:26.125-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:43:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:43:32.316-0500 [conn2054] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T13:43:56.299-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:43:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:44:26.466-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:44:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:44:56.884-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:44:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:45:27.180-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:45:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:45:57.435-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:45:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:46:27.730-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:46:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:46:58.004-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:46:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:47:28.273-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:47:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:47:58.525-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:47:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:48:28.812-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:48:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:48:32.155-0500 [conn2055] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T13:48:59.064-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:48:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:49:29.345-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:49:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:49:59.495-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:49:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:50:29.769-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:50:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:51:00.113-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:50:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:51:30.432-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:51:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:52:00.720-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:52:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:52:30.980-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:52:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:53:01.243-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:53:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:53:31.474-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:53:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:53:32.418-0500 [conn2056] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T13:54:01.752-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:54:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:54:31.973-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:54:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:55:02.112-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:55:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:55:32.296-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:55:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:56:02.576-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:56:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:56:32.842-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:56:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:57:03.200-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:57:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:57:33.526-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:57:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:58:03.807-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:58:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:58:32.308-0500 [conn2057] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T13:58:33.972-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:58:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:59:04.295-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:59:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T13:59:34.451-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 13:59:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:00:04.707-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:00:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:00:35.007-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:00:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:01:05.326-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:01:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:01:35.689-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:01:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:02:06.082-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:02:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:02:36.330-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:02:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:03:06.674-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:03:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:03:32.378-0500 [conn2058] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T14:03:36.984-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:03:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:04:07.185-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:04:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:04:37.603-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:04:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:05:07.900-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:05:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:05:38.183-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:05:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:06:08.448-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:06:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:06:38.610-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:06:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:07:08.892-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:07:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:07:39.212-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:07:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:08:09.499-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:08:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:08:32.266-0500 [conn2059] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T14:08:39.827-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:08:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:09:10.084-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:09:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:09:40.299-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:09:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:10:10.578-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:10:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:10:40.930-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:10:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:11:11.076-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:11:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:11:41.405-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:11:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:12:11.706-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:12:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:12:41.979-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:12:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:13:12.258-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:13:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:13:32.971-0500 [conn2060] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T14:13:42.545-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:13:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:14:12.841-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:14:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:14:42.986-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:14:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:15:13.251-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:15:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:15:43.534-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:15:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:16:13.796-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:16:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:16:44.192-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:16:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:17:14.482-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:17:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:17:44.745-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:17:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:18:15.119-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:18:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:18:32.111-0500 [conn2061] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T14:18:45.391-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:18:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:19:15.672-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:19:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:19:45.950-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:19:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:20:16.227-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:20:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:20:46.476-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:20:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:21:16.865-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:21:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:21:47.221-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:21:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:22:17.427-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:22:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:22:47.786-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:22:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:23:18.110-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:23:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:23:32.149-0500 [conn2062] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T14:23:48.286-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:23:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:24:18.560-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:24:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:24:48.864-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:24:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:25:19.122-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:25:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:25:49.462-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:25:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:26:19.866-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:26:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:26:50.277-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:26:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:27:20.561-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:27:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:27:50.824-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:27:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:28:21.134-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:28:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:28:32.275-0500 [conn2063] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T14:28:51.521-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:28:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:29:21.782-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:29:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:29:52.135-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:29:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:30:22.325-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:30:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:30:52.590-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:30:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:31:22.755-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:31:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:31:52.916-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:31:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:32:23.184-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:32:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:32:53.326-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:32:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:33:23.665-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:33:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:33:32.071-0500 [conn2064] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T14:33:53.809-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:33:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:34:24.040-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:34:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:34:54.228-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:34:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:35:24.372-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:35:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:35:54.661-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:35:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:36:25.102-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:36:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:36:55.410-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:36:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:37:25.671-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:37:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:37:56.152-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:37:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:38:26.324-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:38:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:38:32.260-0500 [conn2065] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T14:38:56.707-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:38:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:39:26.983-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:39:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:39:57.225-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:39:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:40:27.431-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:40:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:40:57.607-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:40:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:41:27.805-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:41:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:41:58.168-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:41:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:42:28.433-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:42:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:42:58.563-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:42:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:43:28.783-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:43:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:43:32.210-0500 [conn2066] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T14:43:59.063-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:43:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:44:29.370-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:44:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:44:59.569-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:44:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:45:29.832-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:45:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:46:00.226-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:45:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:46:30.518-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:46:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:47:00.814-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:47:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:47:30.999-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:47:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:48:01.198-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:48:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:48:31.370-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:48:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:48:32.151-0500 [conn2067] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T14:49:01.662-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:49:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:49:31.960-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:49:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:50:02.223-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:50:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:50:32.485-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:50:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:51:02.773-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:51:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:51:33.002-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:51:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:52:03.369-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:52:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:52:33.658-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:52:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:53:03.928-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:53:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:53:32.304-0500 [conn2068] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T14:53:34.184-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:53:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:54:04.452-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:54:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:54:34.713-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:54:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:55:04.980-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:55:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:55:35.251-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:55:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:56:05.525-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:56:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:56:35.822-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:56:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:57:06.076-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:57:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:57:36.351-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:57:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:58:06.745-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:58:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:58:32.097-0500 [conn2069] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T14:58:37.005-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:58:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:59:07.307-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:59:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T14:59:37.588-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 14:59:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:00:07.952-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:00:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:00:38.206-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:00:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:01:08.349-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:01:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:01:38.617-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:01:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:02:08.893-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:02:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:02:39.259-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:02:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:03:09.614-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:03:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:03:32.268-0500 [conn2070] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T15:03:39.783-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:03:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:04:09.939-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:04:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:04:40.130-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:04:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:05:10.318-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:05:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:05:40.579-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:05:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:06:10.843-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:06:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:06:41.083-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:06:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:07:11.357-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:07:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:07:41.542-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:07:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:08:11.855-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:08:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:08:32.257-0500 [conn2071] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T15:08:42.127-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:08:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:09:12.384-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:09:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:09:42.659-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:09:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:10:12.847-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:10:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:10:43.093-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:10:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:11:13.363-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:11:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:11:43.648-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:11:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:12:13.875-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:12:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:12:44.082-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:12:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:13:14.328-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:13:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:13:32.264-0500 [conn2072] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T15:13:44.654-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:13:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:14:14.976-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:14:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:14:45.262-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:14:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:15:15.537-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:15:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:15:45.795-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:15:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:16:16.062-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:16:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:16:46.399-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:16:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:17:16.589-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:17:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:17:46.856-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:17:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:18:17.207-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:18:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:18:32.366-0500 [conn2073] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T15:18:47.585-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:18:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:19:17.935-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:19:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:19:48.143-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:19:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:20:18.448-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:20:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:20:48.939-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:20:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:21:19.217-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:21:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:21:49.590-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:21:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:22:19.927-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:22:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:22:50.189-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:22:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:23:20.453-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:23:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:23:32.371-0500 [conn2074] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T15:23:50.623-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:23:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:24:20.805-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:24:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:24:51.064-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:24:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:25:21.378-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:25:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:25:51.543-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:25:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:26:21.840-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:26:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:26:52.114-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:26:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:27:22.256-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:27:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:27:52.543-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:27:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:28:22.756-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:28:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:28:32.229-0500 [conn2075] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T15:28:53.186-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:28:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:29:23.493-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:29:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:29:53.710-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:29:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:30:23.981-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:30:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:30:54.128-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:30:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:31:24.382-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:31:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:31:54.672-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:31:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:32:24.962-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:32:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:32:55.419-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:32:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:33:25.691-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:33:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:33:32.871-0500 [conn2076] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T15:33:55.977-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:33:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:34:26.264-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:34:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:34:56.535-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:34:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:35:26.810-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:35:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:35:57.088-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:35:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:36:27.439-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:36:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:36:57.833-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:36:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:37:28.103-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:37:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:37:58.239-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:37:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:38:28.512-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:38:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:38:32.220-0500 [conn2077] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T15:38:58.799-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:38:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:39:29.086-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:39:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:39:59.379-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:39:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:40:29.577-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:40:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:40:59.894-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:40:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:41:30.174-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:41:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:42:00.451-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:42:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:42:30.741-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:42:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:43:00.911-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:43:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:43:31.101-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:43:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:43:32.096-0500 [conn2078] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T15:44:01.412-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:44:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:44:31.693-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:44:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:45:01.841-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:45:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:45:32.313-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:45:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:46:02.535-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:46:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:46:32.773-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:46:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:47:03.125-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:47:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:47:33.342-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:47:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:48:03.610-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:48:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:48:32.187-0500 [conn2079] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T15:48:33.778-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:48:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:49:04.066-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:49:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:49:34.366-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:49:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:50:04.533-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:50:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:50:34.786-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:50:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:51:05.070-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:51:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:51:35.206-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:51:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:52:05.469-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:52:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:52:35.621-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:52:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:53:05.915-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:53:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:53:32.339-0500 [conn2080] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T15:53:36.168-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:53:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:54:06.366-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:54:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:54:36.645-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:54:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:55:06.968-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:55:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:55:37.236-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:55:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:56:07.505-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:56:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:56:37.790-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:56:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:57:08.064-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:57:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:57:38.405-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:57:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:58:08.671-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:58:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:58:32.249-0500 [conn2081] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T15:58:38.983-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:58:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:59:09.278-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:59:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T15:59:39.411-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 15:59:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:00:09.715-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:00:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:00:39.883-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:00:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:01:10.154-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:01:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:01:40.415-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:01:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:02:10.676-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:02:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:02:40.881-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:02:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:03:11.153-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:03:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:03:32.086-0500 [conn2082] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T16:03:41.427-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:03:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:04:11.761-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:04:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:04:42.055-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:04:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:05:12.333-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:05:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:05:42.673-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:05:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:06:12.964-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:06:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:06:43.151-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:06:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:07:13.424-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:07:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:07:43.830-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:07:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:08:13.974-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:08:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:08:32.201-0500 [conn2083] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T16:08:44.268-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:08:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:09:14.411-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:09:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:09:44.687-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:09:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:10:14.948-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:10:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:10:45.320-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:10:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:11:15.479-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:11:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:11:45.645-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:11:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:12:15.976-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:12:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:12:46.149-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:12:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:13:16.426-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:13:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:13:32.100-0500 [conn2084] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T16:13:46.680-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:13:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:14:16.947-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:14:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:14:47.251-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:14:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:15:17.547-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:15:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:15:47.738-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:15:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:16:17.972-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:16:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:16:48.380-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:16:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:17:18.592-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:17:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:17:48.907-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:17:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:18:19.273-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:18:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:18:32.325-0500 [conn2085] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T16:18:49.567-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:18:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:19:19.724-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:19:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:19:49.917-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:19:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:20:20.370-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:20:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:20:50.619-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:20:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:21:20.904-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:21:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:21:51.051-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:21:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:22:21.444-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:22:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:22:51.768-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:22:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:23:22.055-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:23:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:23:32.377-0500 [conn2086] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T16:23:52.292-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:23:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:24:22.603-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:24:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:24:52.898-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:24:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:25:23.271-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:25:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:25:53.410-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:25:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:26:23.851-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:26:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:26:54.040-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:26:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:27:24.372-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:27:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:27:54.512-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:27:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:28:24.892-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:28:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:28:32.242-0500 [conn2087] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T16:28:55.159-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:28:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:29:25.323-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:29:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:29:55.593-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:29:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:30:25.876-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:30:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:30:56.212-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:30:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:31:26.541-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:31:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:31:56.843-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:31:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:32:27.177-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:32:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:32:57.502-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:32:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:33:27.801-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:33:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:33:32.349-0500 [conn2088] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T16:33:57.986-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:33:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:34:28.185-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:34:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:34:58.468-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:34:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:35:28.750-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:35:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:35:58.936-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:35:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:36:29.081-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:36:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:36:59.419-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:36:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:37:29.765-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:37:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:38:00.030-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:37:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:38:30.324-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:38:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:38:32.380-0500 [conn2089] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T16:39:00.545-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:39:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:39:30.708-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:39:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:40:01.070-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:40:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:40:31.316-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:40:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:41:01.591-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:41:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:41:31.874-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:41:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:42:02.184-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:42:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:42:32.488-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:42:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:43:02.676-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:43:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:43:32.353-0500 [conn2090] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T16:43:32.964-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:43:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:44:03.257-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:44:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:44:33.402-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:44:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:45:03.601-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:45:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:45:33.896-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:45:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:46:04.171-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:46:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:46:34.453-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:46:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:47:04.767-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:47:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:47:35.035-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:47:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:48:05.366-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:48:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:48:32.262-0500 [conn2091] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T16:48:35.707-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:48:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:49:06.089-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:49:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:49:36.367-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:49:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:50:06.661-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:50:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:50:36.809-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:50:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:51:07.096-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:51:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:51:37.389-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:51:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:52:07.677-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:52:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:52:37.994-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:52:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:53:08.255-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:53:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:53:32.305-0500 [conn2092] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T16:53:38.442-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:53:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:54:08.581-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:54:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:54:38.766-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:54:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:55:08.920-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:55:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:55:39.114-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:55:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:56:09.374-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:56:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:56:39.664-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:56:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:57:10.058-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:57:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:57:40.338-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:57:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:58:10.535-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:58:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:58:32.156-0500 [conn2093] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T16:58:40.886-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:58:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:59:11.134-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:59:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T16:59:41.397-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 16:59:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:00:11.699-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:00:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:00:42.035-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:00:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:01:12.326-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:01:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:01:42.598-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:01:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:02:12.911-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:02:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:02:43.186-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:02:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:03:13.561-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:03:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:03:32.234-0500 [conn2094] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T17:03:43.832-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:03:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:04:14.173-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:04:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:04:44.550-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:04:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:05:14.845-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:05:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:05:45.135-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:05:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:06:15.290-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:06:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:06:45.566-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:06:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:07:15.753-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:07:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:07:45.984-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:07:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:08:16.144-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:08:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:08:32.298-0500 [conn2095] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T17:08:46.406-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:08:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:09:16.740-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:09:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:09:47.024-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:09:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:10:17.321-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:10:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:10:47.605-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:10:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:11:17.930-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:11:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:11:48.204-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:11:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:12:18.386-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:12:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:12:48.653-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:12:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:13:18.920-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:13:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:13:32.403-0500 [conn2096] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T17:13:49.280-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:13:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:14:19.594-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:14:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:14:49.893-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:14:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:15:20.153-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:15:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:15:50.414-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:15:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:16:20.677-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:16:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:16:50.907-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:16:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:17:21.197-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:17:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:17:51.375-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:17:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:18:21.541-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:18:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:18:32.196-0500 [conn2097] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T17:18:51.811-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:18:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:19:22.134-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:19:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:19:52.448-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:19:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:20:22.612-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:20:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:20:52.921-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:20:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:21:23.187-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:21:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:21:53.542-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:21:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:22:23.713-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:22:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:22:54.014-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:22:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:23:24.179-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:23:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:23:32.299-0500 [conn2098] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T17:23:54.342-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:23:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:24:24.611-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:24:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:24:54.933-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:24:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:25:25.233-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:25:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:25:55.530-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:25:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:26:25.819-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:26:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:26:55.962-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:26:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:27:26.273-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:27:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:27:56.569-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:27:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:28:26.742-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:28:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:28:32.236-0500 [conn2099] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T17:28:57.015-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:28:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:29:27.252-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:29:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:29:57.438-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:29:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:30:27.704-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:30:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:30:58.002-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:30:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:31:28.250-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:31:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:31:58.382-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:31:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:32:28.798-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:32:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:32:59.081-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:32:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:33:29.241-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:33:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:33:32.437-0500 [conn2100] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T17:33:59.459-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:33:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:34:29.609-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:34:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:34:59.895-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:34:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:35:30.183-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:35:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:36:00.452-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:36:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:36:30.728-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:36:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:37:00.957-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:37:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:37:31.242-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:37:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:38:01.400-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:38:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:38:31.633-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:38:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:38:32.119-0500 [conn2101] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T17:39:01.940-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:39:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:39:32.396-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:39:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:40:02.653-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:40:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:40:32.999-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:40:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:41:03.356-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:41:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:41:33.614-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:41:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:42:03.954-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:42:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:42:34.298-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:42:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:43:04.484-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:43:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:43:32.088-0500 [conn2102] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T17:43:34.683-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:43:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:44:04.957-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:44:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:44:35.119-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:44:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:45:05.426-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:45:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:45:35.711-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:45:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:46:06.054-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:46:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:46:36.411-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:46:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:47:06.652-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:47:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:47:36.945-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:47:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:48:07.204-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:48:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:48:32.213-0500 [conn2103] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T17:48:37.467-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:48:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:49:07.713-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:49:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:49:37.998-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:49:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:50:08.274-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:50:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:50:38.424-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:50:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:51:08.766-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:51:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:51:39.056-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:51:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:52:09.363-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:52:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:52:39.722-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:52:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:53:10.135-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:53:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:53:32.398-0500 [conn2104] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T17:53:40.408-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:53:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:54:10.644-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:54:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:54:41.044-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:54:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:55:11.383-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:55:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:55:41.759-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:55:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:56:11.920-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:56:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:56:42.174-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:56:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:57:12.327-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:57:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:57:42.610-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:57:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:58:12.840-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:58:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:58:32.194-0500 [conn2105] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T17:58:43.264-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:58:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:59:14.055-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:59:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T17:59:44.297-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 17:59:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:00:14.585-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:00:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:00:44.821-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:00:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:01:15.203-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:01:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:01:45.532-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:01:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:02:15.750-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:02:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:02:46.025-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:02:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:03:16.283-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:03:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:03:32.253-0500 [conn2106] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T18:03:46.546-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:03:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:04:16.838-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:04:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:04:47.257-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:04:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:05:17.404-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:05:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:05:47.744-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:05:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:06:17.907-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:06:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:06:48.043-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:06:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:07:18.302-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:07:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:07:48.602-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:07:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:08:18.877-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:08:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:08:32.175-0500 [conn2107] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T18:08:49.139-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:08:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:09:19.392-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:09:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:09:49.660-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:09:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:10:19.924-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:10:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:10:50.184-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:10:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:11:20.451-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:11:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:11:50.731-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:11:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:12:21.054-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:12:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:12:51.350-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:12:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:13:21.555-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:13:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:13:32.327-0500 [conn2108] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T18:13:51.908-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:13:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:14:22.177-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:14:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:14:52.452-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:14:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:15:22.723-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:15:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:15:53.020-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:15:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:16:23.291-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:16:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:16:53.557-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:16:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:17:23.850-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:17:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:17:54.105-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:17:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:18:24.427-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:18:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:18:32.274-0500 [conn2109] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T18:18:54.732-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:18:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:19:24.928-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:19:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:19:55.211-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:19:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:20:25.610-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:20:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:20:55.862-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:20:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:21:26.018-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:21:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:21:56.307-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:21:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:22:26.609-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:22:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:22:56.900-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:22:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:23:27.123-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:23:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:23:32.176-0500 [conn2110] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T18:23:57.360-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:23:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:24:27.618-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:24:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:24:57.913-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:24:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:25:28.152-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:25:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:25:58.531-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:25:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:26:28.785-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:26:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:26:59.067-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:26:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:27:29.338-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:27:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:27:59.489-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:27:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:28:29.857-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:28:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:28:32.314-0500 [conn2111] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T18:29:00.182-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:28:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:29:30.463-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:29:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:30:00.761-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:30:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:30:31.043-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:30:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:31:01.326-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:31:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:31:31.600-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:31:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:32:02.015-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:32:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:32:32.253-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:32:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:33:02.443-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:33:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:33:32.178-0500 [conn2112] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T18:33:32.741-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:33:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:34:03.023-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:34:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:34:33.377-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:34:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:35:03.655-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:35:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:35:33.925-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:35:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:36:04.061-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:36:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:36:34.351-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:36:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:37:04.691-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:37:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:37:34.828-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:37:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:38:05.074-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:38:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:38:32.142-0500 [conn2113] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T18:38:35.220-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:38:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:39:05.506-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:39:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:39:35.729-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:39:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:40:05.932-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:40:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:40:36.212-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:40:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:41:06.586-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:41:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:41:36.863-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:41:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:42:07.159-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:42:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:42:37.443-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:42:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:43:07.833-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:43:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:43:32.170-0500 [conn2114] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T18:43:38.026-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:43:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:44:08.242-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:44:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:44:38.454-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:44:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:45:08.879-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:45:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:45:39.122-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:45:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:46:09.407-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:46:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:46:39.700-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:46:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:47:09.984-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:47:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:47:40.260-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:47:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:48:10.559-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:48:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:48:32.376-0500 [conn2115] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T18:48:40.838-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:48:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:49:11.129-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:49:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:49:41.412-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:49:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:50:11.742-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:50:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:50:42.019-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:50:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:51:12.215-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:51:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:51:42.496-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:51:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:52:12.848-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:52:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:52:43.134-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:52:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:53:13.267-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:53:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:53:32.371-0500 [conn2116] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T18:53:43.613-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:53:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:54:13.880-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:54:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:54:44.162-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:54:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:55:14.455-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:55:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:55:44.736-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:55:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:56:15.038-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:56:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:56:45.352-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:56:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:57:15.616-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:57:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:57:45.893-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:57:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:58:16.200-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:58:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:58:32.269-0500 [conn2117] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T18:58:46.491-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:58:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:59:16.654-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:59:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T18:59:46.941-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 18:59:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:00:17.228-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:00:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:00:47.501-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:00:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:01:17.736-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:01:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:01:47.993-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:01:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:02:18.348-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:02:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:02:48.641-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:02:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:03:18.818-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:03:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:03:32.330-0500 [conn2118] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T19:03:49.005-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:03:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:04:19.175-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:04:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:04:49.348-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:04:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:05:19.655-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:05:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:05:49.825-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:05:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:06:19.983-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:06:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:06:50.220-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:06:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:07:20.523-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:07:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:07:50.669-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:07:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:08:20.954-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:08:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:08:32.250-0500 [conn2119] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T19:08:51.261-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:08:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:09:21.549-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:09:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:09:51.819-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:09:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:10:22.019-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:10:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:10:52.178-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:10:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:11:22.450-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:11:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:11:52.728-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:11:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:12:22.970-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:12:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:12:53.245-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:12:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:13:23.522-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:13:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:13:32.101-0500 [conn2120] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T19:13:53.848-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:13:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:14:24.124-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:14:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:14:54.326-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:14:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:15:24.615-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:15:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:15:54.908-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:15:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:16:25.198-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:16:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:16:55.467-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:16:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:17:25.752-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:17:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:17:55.967-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:17:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:18:26.113-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:18:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:18:32.197-0500 [conn2121] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T19:18:56.423-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:18:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:19:26.682-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:19:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:19:56.885-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:19:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:20:27.160-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:20:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:20:57.476-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:20:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:21:27.838-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:21:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:21:58.237-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:21:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:22:28.533-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:22:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:22:58.685-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:22:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:23:29.028-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:23:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:23:32.305-0500 [conn2122] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T19:23:59.324-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:23:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:24:29.477-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:24:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:24:59.662-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:24:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:25:29.946-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:25:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:26:00.234-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:25:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:26:30.403-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:26:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:27:00.694-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:27:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:27:30.957-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:27:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:28:01.178-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:28:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:28:31.533-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:28:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:28:32.114-0500 [conn2123] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T19:29:01.734-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:29:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:29:31.973-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:29:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:30:02.238-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:30:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:30:32.596-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:30:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:31:02.876-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:31:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:31:33.166-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:31:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:32:03.574-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:32:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:32:33.984-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:32:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:33:04.218-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:33:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:33:32.255-0500 [conn2124] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T19:33:34.487-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:33:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:34:04.786-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:34:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:34:35.021-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:34:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:35:05.317-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:35:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:35:35.464-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:35:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:36:05.749-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:36:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:36:36.078-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:36:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:37:06.336-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:37:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:37:36.653-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:37:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:38:07.066-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:38:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:38:32.123-0500 [conn2125] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T19:38:37.272-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:38:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:39:07.557-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:39:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:39:37.688-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:39:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:40:08.043-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:40:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:40:38.475-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:40:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:41:08.691-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:41:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:41:38.994-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:41:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:42:09.255-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:42:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:42:39.532-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:42:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:43:09.860-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:43:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:43:32.094-0500 [conn2126] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T19:43:40.131-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:43:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:44:10.399-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:44:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:44:40.710-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:44:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:45:10.938-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:45:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:45:41.169-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:45:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:46:11.453-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:46:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:46:41.789-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:46:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:47:11.998-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:47:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:47:42.269-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:47:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:48:12.591-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:48:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:48:32.103-0500 [conn2127] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T19:48:42.895-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:48:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:49:13.176-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:49:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:49:43.486-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:49:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:50:13.758-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:50:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:50:44.024-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:50:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:51:14.300-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:51:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:51:44.628-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:51:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:52:14.898-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:52:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:52:45.241-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:52:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:53:15.545-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:53:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:53:32.074-0500 [conn2128] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T19:53:45.817-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:53:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:54:16.109-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:54:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:54:46.341-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:54:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:55:16.657-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:55:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:55:46.816-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:55:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:56:16.966-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:56:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:56:47.256-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:56:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:57:17.395-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:57:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:57:47.690-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:57:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:58:17.969-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:58:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:58:32.224-0500 [conn2129] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T19:58:48.299-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:58:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:59:18.595-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:59:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T19:59:48.981-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 19:59:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:00:19.260-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:00:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:00:49.521-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:00:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:01:19.799-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:01:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:01:50.097-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:01:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:02:20.404-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:02:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:02:50.684-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:02:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:03:20.879-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:03:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:03:32.238-0500 [conn2130] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T20:03:51.173-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:03:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:04:21.542-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:04:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:04:51.807-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:04:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:05:22.108-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:05:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:05:52.391-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:05:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:06:22.675-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:06:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:06:52.945-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:06:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:07:23.284-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:07:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:07:53.486-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:07:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:08:23.790-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:08:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:08:32.104-0500 [conn2131] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T20:08:54.025-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:08:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:09:24.327-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:09:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:09:54.522-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:09:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:10:24.905-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:10:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:10:55.194-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:10:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:11:25.440-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:11:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:11:55.714-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:11:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:12:26.046-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:12:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:12:56.313-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:12:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:13:26.602-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:13:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:13:32.285-0500 [conn2132] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T20:13:56.890-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:13:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:14:27.188-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:14:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:14:57.611-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:14:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:15:27.893-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:15:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:15:58.201-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:15:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:16:28.541-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:16:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:16:58.746-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:16:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:17:29.024-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:17:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:17:59.193-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:17:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:18:29.462-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:18:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:18:32.374-0500 [conn2133] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T20:18:59.889-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:18:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:19:30.045-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:19:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:20:00.222-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:20:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:20:30.483-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:20:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:21:00.770-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:21:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:21:30.995-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:21:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:22:01.153-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:22:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:22:31.554-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:22:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:23:01.719-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:23:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:23:31.970-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:23:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:23:32.095-0500 [conn2134] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T20:24:02.130-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:24:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:24:32.433-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:24:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:25:02.587-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:25:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:25:32.857-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:25:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:26:03.069-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:26:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:26:33.367-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:26:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:27:03.532-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:27:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:27:33.685-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:27:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:28:03.991-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:28:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:28:32.256-0500 [conn2135] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T20:28:34.125-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:28:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:29:04.378-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:29:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:29:34.649-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:29:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:30:04.837-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:30:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:30:35.112-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:30:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:31:05.381-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:31:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:31:35.741-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:31:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:32:06.113-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:32:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:32:36.350-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:32:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:33:06.575-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:33:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:33:32.236-0500 [conn2136] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T20:33:36.859-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:33:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:34:07.010-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:34:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:34:37.291-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:34:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:35:07.441-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:35:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:35:37.705-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:35:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:36:07.974-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:36:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:36:38.255-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:36:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:37:08.516-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:37:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:37:38.790-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:37:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:38:09.221-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:38:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:38:32.234-0500 [conn2137] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T20:38:39.518-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:38:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:39:09.835-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:39:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:39:40.123-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:39:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:40:10.453-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:40:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:40:40.716-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:40:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:41:10.932-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:41:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:41:41.246-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:41:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:42:11.591-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:42:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:42:41.869-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:42:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:43:12.097-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:43:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:43:32.318-0500 [conn2138] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T20:43:42.424-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:43:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:44:12.709-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:44:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:44:42.956-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:44:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:45:13.170-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:45:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:45:43.429-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:45:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:46:13.716-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:46:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:46:43.936-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:46:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:47:14.180-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:47:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:47:44.419-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:47:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:48:14.671-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:48:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:48:32.182-0500 [conn2139] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T20:48:44.856-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:48:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:49:15.117-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:49:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:49:45.403-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:49:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:50:15.686-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:50:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:50:46.072-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:50:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:51:16.334-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:51:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:51:46.595-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:51:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:52:16.957-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:52:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:52:47.136-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:52:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:53:17.393-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:53:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:53:32.125-0500 [conn2140] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T20:53:47.679-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:53:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:54:17.950-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:54:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:54:48.092-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:54:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:55:18.371-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:55:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:55:48.512-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:55:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:56:18.682-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:56:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:56:48.859-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:56:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:57:19.121-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:57:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:57:49.332-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:57:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:58:19.613-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:58:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:58:32.192-0500 [conn2141] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T20:58:49.834-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:58:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:59:20.123-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:59:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T20:59:50.396-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 20:59:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:00:20.795-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:00:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:00:51.099-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:00:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:01:21.387-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:01:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:01:51.653-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:01:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:02:21.936-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:02:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:02:52.261-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:02:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:03:22.634-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:03:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:03:32.253-0500 [conn2142] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T21:03:52.950-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:03:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:04:23.375-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:04:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:04:53.729-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:04:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:05:23.982-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:05:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:05:54.266-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:05:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:06:24.653-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:06:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:06:54.889-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:06:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:07:25.156-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:07:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:07:55.318-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:07:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:08:25.659-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:08:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:08:32.147-0500 [conn2143] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T21:08:55.799-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:08:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:09:26.143-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:09:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:09:56.436-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:09:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:10:26.586-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:10:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:10:56.873-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:10:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:11:27.143-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:11:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:11:57.421-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:11:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:12:27.705-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:12:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:12:58.079-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:12:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:13:28.340-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:13:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:13:32.158-0500 [conn2144] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T21:13:58.683-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:13:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:14:28.836-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:14:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:14:59.070-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:14:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:15:29.208-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:15:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:15:59.514-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:15:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:16:29.718-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:16:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:17:00.114-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:16:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:17:30.466-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:17:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:18:00.751-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:18:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:18:30.904-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:18:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:18:32.135-0500 [conn2145] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T21:19:01.206-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:19:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:19:31.369-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:19:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:20:01.645-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:20:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:20:31.957-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:20:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:21:02.239-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:21:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:21:32.528-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:21:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:22:02.728-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:22:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:22:32.894-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:22:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:23:03.158-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:23:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:23:32.276-0500 [conn2146] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T21:23:33.444-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:23:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:24:03.596-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:24:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:24:33.859-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:24:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:25:04.176-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:25:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:25:34.661-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:25:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:26:04.960-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:26:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:26:35.241-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:26:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:27:05.568-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:27:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:27:35.855-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:27:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:28:06.177-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:28:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:28:32.164-0500 [conn2147] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T21:28:36.478-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:28:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:29:06.760-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:29:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:29:36.987-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:29:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:30:07.309-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:30:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:30:37.577-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:30:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:31:07.790-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:31:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:31:38.181-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:31:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:32:08.553-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:32:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:32:38.782-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:32:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:33:09.020-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:33:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:33:32.275-0500 [conn2148] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T21:33:39.311-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:33:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:34:09.636-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:34:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:34:39.937-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:34:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:35:10.334-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:35:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:35:40.602-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:35:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:36:10.768-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:36:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:36:41.017-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:36:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:37:11.375-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:37:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:37:41.583-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:37:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:38:11.846-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:38:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:38:32.289-0500 [conn2149] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T21:38:42.113-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:38:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:39:12.420-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:39:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:39:42.802-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:39:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:40:13.070-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:40:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:40:43.335-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:40:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:41:13.583-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:41:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:41:43.897-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:41:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:42:14.157-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:42:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:42:44.446-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:42:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:43:14.730-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:43:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:43:32.295-0500 [conn2150] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T21:43:45.020-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:43:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:44:15.327-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:44:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:44:45.586-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:44:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:45:15.804-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:45:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:45:45.984-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:45:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:46:16.283-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:46:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:46:46.540-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:46:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:47:16.780-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:47:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:47:46.975-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:47:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:48:17.143-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:48:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:48:32.171-0500 [conn2151] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T21:48:47.431-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:48:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:49:17.576-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:49:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:49:47.848-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:49:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:50:18.116-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:50:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:50:48.337-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:50:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:51:18.540-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:51:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:51:48.726-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:51:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:52:19.093-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:52:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:52:49.496-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:52:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:53:19.821-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:53:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:53:32.284-0500 [conn2152] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T21:53:50.152-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:53:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:54:20.476-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:54:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:54:50.797-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:54:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:55:21.122-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:55:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:55:51.398-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:55:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:56:21.862-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:56:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:56:52.003-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:56:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:57:22.220-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:57:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:57:52.520-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:57:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:58:22.779-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:58:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:58:32.113-0500 [conn2153] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T21:58:52.981-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:58:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:59:23.280-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:59:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T21:59:53.449-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 21:59:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:00:23.739-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:00:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:00:53.957-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:00:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:01:24.102-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:01:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:01:54.374-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:01:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:02:24.632-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:02:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:02:54.893-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:02:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:03:25.163-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:03:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:03:32.123-0500 [conn2154] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T22:03:55.566-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:03:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:04:25.850-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:04:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:04:56.149-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:04:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:05:26.391-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:05:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:05:56.711-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:05:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:06:27.000-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:06:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:06:57.272-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:06:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:07:27.601-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:07:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:07:57.795-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:07:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:08:28.083-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:08:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:08:32.295-0500 [conn2155] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T22:08:58.383-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:08:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:09:28.634-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:09:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:09:58.772-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:09:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:10:29.150-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:10:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:10:59.304-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:10:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:11:29.491-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:11:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:11:59.723-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:11:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:12:30.011-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:12:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:13:00.324-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:13:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:13:30.689-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:13:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:13:32.307-0500 [conn2156] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T22:14:01.009-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:14:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:14:31.294-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:14:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:15:01.448-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:15:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:15:31.722-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:15:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:16:02.071-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:16:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:16:32.364-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:16:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:17:02.746-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:17:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:17:33.204-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:17:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:18:03.583-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:18:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:18:32.262-0500 [conn2157] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T22:18:33.835-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:18:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:19:04.202-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:19:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:19:34.500-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:19:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:20:04.890-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:20:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:20:35.168-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:20:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:21:05.450-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:21:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:21:35.705-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:21:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:22:05.986-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:22:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:22:36.247-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:22:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:23:06.439-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:23:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:23:32.253-0500 [conn2158] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T22:23:36.758-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:23:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:24:06.953-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:24:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:24:37.241-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:24:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:25:07.541-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:25:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:25:37.959-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:25:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:26:08.373-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:26:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:26:38.720-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:26:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:27:08.870-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:27:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:27:39.006-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:27:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:28:09.290-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:28:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:28:32.226-0500 [conn2159] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T22:28:39.606-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:28:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:29:09.808-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:29:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:29:40.095-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:29:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:30:10.478-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:30:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:30:40.689-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:30:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:31:10.995-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:31:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:31:41.408-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:31:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:32:11.709-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:32:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:32:42.016-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:32:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:33:12.391-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:33:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:33:32.308-0500 [conn2160] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T22:33:42.561-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:33:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:34:12.848-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:34:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:34:43.185-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:34:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:35:13.324-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:35:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:35:43.615-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:35:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:36:13.819-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:36:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:36:44.144-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:36:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:37:14.414-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:37:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:37:44.873-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:37:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:38:15.031-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:38:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:38:32.116-0500 [conn2161] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T22:38:45.317-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:38:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:39:15.578-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:39:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:39:45.845-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:39:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:40:16.159-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:40:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:40:46.430-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:40:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:41:16.834-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:41:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:41:47.222-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:41:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:42:17.486-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:42:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:42:47.794-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:42:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:43:18.060-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:43:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:43:32.207-0500 [conn2162] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T22:43:48.251-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:43:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:44:18.539-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:44:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:44:48.889-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:44:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:45:19.225-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:45:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:45:49.575-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:45:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:46:19.768-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:46:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:46:49.950-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:46:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:47:20.288-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:47:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:47:50.493-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:47:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:48:20.746-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:48:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:48:32.217-0500 [conn2163] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T22:48:51.160-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:48:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:49:21.446-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:49:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:49:51.730-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:49:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:50:22.014-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:50:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:50:52.287-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:50:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:51:22.597-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:51:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:51:52.734-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:51:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:52:23.124-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:52:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:52:53.380-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:52:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:53:23.761-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:53:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:53:32.228-0500 [conn2164] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T22:53:54.089-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:53:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:54:24.460-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:54:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:54:54.759-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:54:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:55:25.042-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:55:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:55:55.323-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:55:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:56:25.482-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:56:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:56:55.789-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:56:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:57:26.179-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:57:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:57:56.462-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:57:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:58:26.774-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:58:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:58:32.213-0500 [conn2165] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T22:58:57.046-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:58:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:59:27.312-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:59:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T22:59:57.591-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 22:59:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:00:27.954-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:00:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:00:58.246-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:00:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:01:28.573-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:01:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:01:58.995-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:01:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:02:29.170-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:02:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:02:59.476-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:02:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:03:29.680-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:03:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:03:32.177-0500 [conn2166] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T23:03:59.814-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:03:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:04:30.088-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:04:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:05:00.366-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:05:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:05:30.641-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:05:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:06:00.924-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:06:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:06:31.201-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:06:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:07:01.493-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:07:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:07:31.780-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:07:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:08:02.067-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:08:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:08:32.157-0500 [conn2167] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T23:08:32.262-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:08:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:09:02.540-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:09:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:09:32.890-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:09:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:10:03.179-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:10:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:10:33.347-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:10:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:11:03.670-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:11:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:11:33.953-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:11:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:12:04.186-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:12:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:12:34.496-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:12:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:13:04.788-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:13:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:13:32.328-0500 [conn2168] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T23:13:35.048-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:13:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:14:05.390-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:14:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:14:35.544-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:14:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:15:05.827-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:15:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:15:36.221-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:15:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:16:06.501-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:16:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:16:36.663-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:16:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:17:06.928-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:17:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:17:37.115-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:17:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:18:07.376-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:18:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:18:32.323-0500 [conn2169] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T23:18:37.515-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:18:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:19:07.812-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:19:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:19:38.153-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:19:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:20:08.374-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:20:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:20:38.660-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:20:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:21:08.848-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:21:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:21:39.053-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:21:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:22:09.333-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:22:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:22:39.615-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:22:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:23:09.897-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:23:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:23:32.273-0500 [conn2170] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T23:23:40.173-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:23:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:24:10.457-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:24:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:24:40.702-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:24:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:25:10.965-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:25:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:25:41.315-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:25:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:26:11.623-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:26:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:26:41.879-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:26:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:27:12.232-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:27:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:27:42.527-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:27:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:28:12.723-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:28:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:28:32.281-0500 [conn2171] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T23:28:42.899-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:28:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:29:13.146-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:29:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:29:43.464-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:29:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:30:13.792-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:30:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:30:44.081-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:30:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:31:14.403-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:31:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:31:44.695-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:31:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:32:14.963-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:32:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:32:45.260-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:32:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:33:15.468-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:33:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:33:32.113-0500 [conn2172] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T23:33:45.634-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:33:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:34:15.903-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:34:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:34:46.286-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:34:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:35:16.644-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:35:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:35:46.927-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:35:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:36:17.211-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:36:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:36:47.406-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:36:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:37:17.830-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:37:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:37:48.094-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:37:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:38:18.366-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:38:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:38:32.315-0500 [conn2173] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T23:38:48.670-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:38:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:39:18.867-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:39:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:39:49.134-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:39:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:40:19.397-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:40:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:40:49.690-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:40:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:41:19.997-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:41:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:41:50.195-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:41:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:42:20.489-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:42:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:42:50.847-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:42:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:43:20.984-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:43:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:43:32.283-0500 [conn2174] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T23:43:51.322-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:43:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:44:21.611-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:44:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:44:51.818-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:44:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:45:21.956-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:45:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:45:52.222-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:45:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:46:22.519-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:46:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:46:52.806-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:46:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:47:22.956-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:47:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:47:53.241-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:47:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:48:23.635-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:48:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:48:32.203-0500 [conn2175] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T23:48:53.837-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:48:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:49:24.066-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:49:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:49:54.339-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:49:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:50:24.469-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:50:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:50:54.876-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:50:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:51:25.131-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:51:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:51:55.405-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:51:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:52:25.675-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:52:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:52:56.002-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:52:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:53:26.328-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:53:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:53:32.257-0500 [conn2176] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T23:53:56.614-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:53:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:54:26.910-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:54:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:54:57.163-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:54:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:55:27.477-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:55:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:55:57.762-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:55:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:56:28.066-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:56:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:56:58.418-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:56:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:57:28.682-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:57:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:57:58.997-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:57:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:58:29.279-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:58:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:58:32.219-0500 [conn2177] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-29T23:58:59.466-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:58:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-29T23:59:29.844-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:59:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:00:00.085-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Sun Jan 29 23:59:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:00:05.050-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ec8549527cdec667c1421 2017-01-30T00:00:05.955-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:00:12.207-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ec85c9527cdec667c1422 2017-01-30T00:00:12.844-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:00:19.180-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ec8629527cdec667c1423 2017-01-30T00:00:20.016-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:00:30.453-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:00:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:01:00.762-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:01:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:01:02.745-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ec88e9527cdec667c1424 2017-01-30T00:01:03.377-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:01:09.782-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ec8959527cdec667c1425 2017-01-30T00:01:10.508-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:01:16.712-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:01:16.713-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:01:23.208-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ec8a29527cdec667c1427 2017-01-30T00:01:23.790-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:01:31.076-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:01:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:02:01.388-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:02:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:02:31.669-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:02:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:03:01.967-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:03:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:03:13.414-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ec9119527cdec667c1428 2017-01-30T00:03:14.022-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:03:32.265-0500 [conn2178] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T00:03:32.357-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:03:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:04:02.542-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:04:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:04:02.760-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ec9429527cdec667c1429 2017-01-30T00:04:03.362-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:04:32.895-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:04:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:04:52.022-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:04:52.023-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:05:03.223-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:05:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:05:33.497-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:05:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:05:46.921-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ec9aa9527cdec667c142b 2017-01-30T00:05:47.585-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:06:03.815-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:06:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:06:30.348-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:06:30.348-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:06:34.037-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:06:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:06:55.035-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ec9ee9527cdec667c142d 2017-01-30T00:06:55.727-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:07:04.303-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:07:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:07:34.580-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:07:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:07:56.522-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588eca2be3904bd49a01ec69') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485752876394), why: "doing balance round", ts: ObjectId('588eca2c9527cdec667c142e') } } gle1: { lastOp: Timestamp 1485752815000|26, connectionId: 21778, updatedExisting: false, n: 0, syncMillis: 22, writtenTo: null, err: null, waited: 22, ok: 1.0 } gle2: { lastOp: Timestamp 1485752876000|27, connectionId: 393608, updatedExisting: true, n: 1, syncMillis: 34, writtenTo: null, err: null, waited: 34, ok: 1.0 } 2017-01-30T00:07:56.532-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-30T00:07:56.665-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588eca2c9527cdec667c142e 2017-01-30T00:07:57.195-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:08:04.908-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:08:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:08:32.168-0500 [conn2179] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T00:08:35.239-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:08:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:09:05.427-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:09:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:09:16.519-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588eca7c9527cdec667c142f 2017-01-30T00:09:17.127-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:09:29.498-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:09:29.498-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:09:35.746-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:09:35.746-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:09:35.779-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:09:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:10:05.934-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:10:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:10:36.241-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:10:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:10:48.788-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:10:48.788-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:10:55.062-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ecade9527cdec667c1433 2017-01-30T00:10:55.695-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:11:06.578-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:11:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:11:20.392-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ecaf89527cdec667c1434 2017-01-30T00:11:21.201-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:11:27.668-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ecaff9527cdec667c1435 2017-01-30T00:11:28.348-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:11:36.765-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:11:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:11:58.818-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:11:58.818-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:12:06.979-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:12:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:12:11.166-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:12:11.166-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:12:23.463-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:12:23.463-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:12:29.679-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:12:29.680-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:12:35.871-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:12:35.872-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:12:37.216-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:12:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:12:42.046-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:12:42.046-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:13:06.476-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:13:06.477-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:13:07.579-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:13:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:13:12.895-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ecb689527cdec667c143d 2017-01-30T00:13:13.536-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:13:19.823-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:13:19.823-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:13:32.105-0500 [conn2180] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T00:13:37.854-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:13:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:14:08.234-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:14:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:14:08.707-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:14:08.707-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:14:27.199-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ecbb29527cdec667c1440 2017-01-30T00:14:27.940-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:14:38.492-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:14:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:14:46.353-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ecbc69527cdec667c1441 2017-01-30T00:14:46.920-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:15:08.731-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:15:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:15:17.537-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ecbe59527cdec667c1442 2017-01-30T00:15:18.299-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:15:39.073-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:15:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:16:09.365-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:16:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:16:13.227-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:16:13.227-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:16:19.440-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:16:19.440-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:16:25.682-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ecc299527cdec667c1445 2017-01-30T00:16:26.282-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:16:32.613-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ecc309527cdec667c1446 2017-01-30T00:16:33.310-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:16:39.642-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:16:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:16:39.645-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ecc379527cdec667c1447 2017-01-30T00:16:40.290-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:17:09.919-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:17:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:17:40.263-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:17:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:18:10.561-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:18:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:18:32.217-0500 [conn2181] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T00:18:40.877-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:18:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:18:42.150-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588eccb19527cdec667c1448 2017-01-30T00:18:42.815-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:18:49.113-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:18:49.113-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:19:01.521-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588eccc59527cdec667c144a 2017-01-30T00:19:02.292-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:19:08.501-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:19:08.501-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:19:11.040-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:19:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:19:33.124-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588ecce3e3904bd49a01ec81') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485753572914), why: "doing balance round", ts: ObjectId('588ecce49527cdec667c144c') } } gle1: { lastOp: Timestamp 1485753573000|2, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 27, writtenTo: null, err: null, waited: 27, ok: 1.0 } gle2: { lastOp: Timestamp 1485753542000|7, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 16, writtenTo: null, err: null, waited: 16, ok: 1.0 } 2017-01-30T00:19:33.134-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-30T00:19:33.270-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ecce49527cdec667c144c 2017-01-30T00:19:33.972-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:19:41.320-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:19:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:19:46.387-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588eccf29527cdec667c144d 2017-01-30T00:19:47.057-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:20:11.668-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:20:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:20:23.701-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ecd179527cdec667c144e 2017-01-30T00:20:24.396-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:20:41.955-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:20:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:20:49.099-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ecd309527cdec667c144f 2017-01-30T00:20:49.744-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:21:12.228-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:21:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:21:26.290-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:21:26.290-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:21:42.503-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:21:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:21:44.914-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ecd689527cdec667c1451 2017-01-30T00:21:45.580-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:21:57.866-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588ecd74a3570fe1db442566') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485753717739), why: "doing balance round", ts: ObjectId('588ecd759527cdec667c1452') } } gle1: { lastOp: Timestamp 1485753705000|10, connectionId: 21778, updatedExisting: false, n: 0, syncMillis: 29, writtenTo: null, err: null, waited: 29, ok: 1.0 } gle2: { lastOp: Timestamp 1485753717000|19, connectionId: 6379656, updatedExisting: true, n: 1, syncMillis: 22, writtenTo: null, err: null, waited: 22, ok: 1.0 } 2017-01-30T00:21:57.873-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-30T00:21:57.873-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:22:12.768-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:22:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:22:12.768-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-30T00:22:12.843-0500 [LockPinger] handled late remove of old distributed lock with ts 588ecd759527cdec667c1452 2017-01-30T00:22:16.235-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ecd889527cdec667c1453 2017-01-30T00:22:16.830-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:22:43.107-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:22:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:23:13.306-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:23:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:23:17.774-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:23:17.774-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:23:32.324-0500 [conn2182] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T00:23:43.624-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:23:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:23:48.425-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ecde49527cdec667c1455 2017-01-30T00:23:49.089-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:24:13.942-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:24:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:24:43.928-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:24:43.928-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:24:44.216-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:24:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:25:14.479-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:25:14.479-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:25:14.513-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:25:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:25:44.774-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:25:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:25:51.151-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:25:51.151-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:26:15.071-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:26:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:26:45.360-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:26:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:27:15.655-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:27:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:27:45.802-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:27:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:28:11.226-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:28:11.226-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:28:16.088-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:28:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:28:32.130-0500 [conn2183] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T00:28:46.385-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:28:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:29:16.672-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:29:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:29:46.965-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:29:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:30:06.905-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ecf5e9527cdec667c145a 2017-01-30T00:30:07.679-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:30:17.164-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:30:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:30:20.141-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ecf6b9527cdec667c145b 2017-01-30T00:30:20.736-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:30:27.075-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ecf729527cdec667c145c 2017-01-30T00:30:27.818-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:30:47.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:30:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:30:52.398-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ecf8c9527cdec667c145d 2017-01-30T00:30:53.104-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:31:17.562-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:31:17.562-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:31:17.701-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:31:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:31:29.836-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:31:29.836-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:31:47.992-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:31:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:32:00.504-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ecfd09527cdec667c1460 2017-01-30T00:32:01.159-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:32:07.649-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ecfd79527cdec667c1461 2017-01-30T00:32:08.390-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:32:14.665-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ecfde9527cdec667c1462 2017-01-30T00:32:15.297-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:32:18.351-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:32:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:32:46.115-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ecffd9527cdec667c1463 2017-01-30T00:32:46.853-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:32:48.515-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:32:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:32:53.205-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ed0049527cdec667c1464 2017-01-30T00:32:53.949-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:33:18.848-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:33:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:33:32.126-0500 [conn2184] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T00:33:36.654-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:33:36.654-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:33:49.162-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:33:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:34:07.219-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ed04e9527cdec667c1466 2017-01-30T00:34:07.956-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:34:14.178-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:34:14.179-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:34:19.380-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:34:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:34:49.682-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:34:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:35:19.961-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:35:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:35:33.410-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:35:33.410-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:35:39.663-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ed0ab9527cdec667c1469 2017-01-30T00:35:40.327-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:35:50.247-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:35:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:36:16.883-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:36:16.883-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:36:20.586-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:36:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:36:23.191-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:36:23.191-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:36:50.872-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:36:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:36:53.692-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:36:53.692-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:37:06.179-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ed1019527cdec667c146d 2017-01-30T00:37:06.857-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:37:21.163-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:37:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:37:31.465-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ed11b9527cdec667c146e 2017-01-30T00:37:32.092-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:37:44.516-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ed1289527cdec667c146f 2017-01-30T00:37:45.151-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:37:51.554-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:37:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:38:09.953-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ed1419527cdec667c1470 2017-01-30T00:38:10.656-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:38:21.707-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:38:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:38:32.224-0500 [conn2185] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T00:38:52.050-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:38:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:38:53.354-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ed16d9527cdec667c1471 2017-01-30T00:38:53.989-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:39:00.449-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ed1749527cdec667c1472 2017-01-30T00:39:01.253-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:39:22.297-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:39:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:39:25.771-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:39:25.771-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:39:52.582-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:39:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:40:08.363-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:40:08.363-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:40:23.007-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:40:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:40:53.342-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:40:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:41:23.623-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:41:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:41:54.094-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:41:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:42:04.045-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ed22b9527cdec667c1475 2017-01-30T00:42:04.749-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:42:11.026-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ed2329527cdec667c1476 2017-01-30T00:42:11.754-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:42:24.388-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:42:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:42:54.644-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:42:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:43:18.748-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ed2769527cdec667c1477 2017-01-30T00:43:19.489-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:43:24.787-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:43:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:43:31.844-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:43:31.844-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:43:32.246-0500 [conn2186] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T00:43:55.057-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:43:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:44:25.402-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:44:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:44:55.695-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:44:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:45:03.107-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:45:03.107-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:45:25.883-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:45:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:45:51.936-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588ed30eaa6da0fe8d55a877') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485755151794), why: "doing balance round", ts: ObjectId('588ed30f9527cdec667c147a') } } gle1: { lastOp: Timestamp 1485755151000|17, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 32, writtenTo: null, err: null, waited: 32, ok: 1.0 } gle2: { lastOp: Timestamp 1485754999000|11, connectionId: 393608, updatedExisting: false, n: 0, syncMillis: 30, writtenTo: null, err: null, waited: 30, ok: 1.0 } 2017-01-30T00:45:51.946-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-30T00:45:52.082-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ed30f9527cdec667c147a 2017-01-30T00:45:52.720-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:45:56.202-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:45:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:46:05.159-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ed31c9527cdec667c147b 2017-01-30T00:46:05.865-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:46:26.485-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:46:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:46:30.229-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588ed3356dca7bf37970cb51') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485755190153), why: "doing balance round", ts: ObjectId('588ed3369527cdec667c147c') } } gle1: { lastOp: Timestamp 1485755190000|6, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 6, writtenTo: null, err: null, waited: 6, ok: 1.0 } gle2: { lastOp: Timestamp 1485755165000|17, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 16, writtenTo: null, err: null, waited: 16, ok: 1.0 } 2017-01-30T00:46:30.291-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-30T00:46:30.377-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ed3369527cdec667c147c 2017-01-30T00:46:30.974-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:46:37.220-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ed33d9527cdec667c147d 2017-01-30T00:46:37.958-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:46:44.193-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:46:44.193-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:46:56.717-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:46:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:47:27.062-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:47:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:47:27.065-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ed36e9527cdec667c147f 2017-01-30T00:47:27.807-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:47:57.345-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:47:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:48:16.500-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:48:16.500-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:48:27.712-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:48:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:48:32.242-0500 [conn2187] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T00:48:34.884-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:48:34.884-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:48:47.166-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:48:47.166-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:48:57.985-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:48:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:48:59.514-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:48:59.514-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:49:28.254-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:49:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:49:36.185-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:49:36.185-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:49:58.450-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:49:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:50:18.935-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ed41a9527cdec667c1485 2017-01-30T00:50:19.596-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:50:28.702-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:50:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:50:32.033-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ed4279527cdec667c1486 2017-01-30T00:50:32.733-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:50:51.193-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ed43a9527cdec667c1487 2017-01-30T00:50:51.823-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:50:58.945-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:50:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:51:16.335-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ed4549527cdec667c1488 2017-01-30T00:51:16.933-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:51:29.178-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:51:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:51:59.464-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:51:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:52:29.750-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:52:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:52:59.959-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:52:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:53:30.234-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:53:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:53:32.200-0500 [conn2188] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T00:54:00.524-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:54:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:54:07.157-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:54:07.157-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:54:25.460-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:54:25.460-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:54:30.741-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:54:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:54:37.796-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:54:37.796-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:54:50.086-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:54:50.086-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:55:01.023-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:55:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:55:02.447-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:55:02.447-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:55:31.321-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:55:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:55:39.108-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ed55a9527cdec667c148e 2017-01-30T00:55:39.816-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:55:58.202-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ed56e9527cdec667c148f 2017-01-30T00:55:59.010-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:56:01.616-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:56:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:56:11.297-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ed57b9527cdec667c1490 2017-01-30T00:56:11.963-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:56:31.929-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:56:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:56:42.514-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:56:42.514-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:56:54.943-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ed5a69527cdec667c1492 2017-01-30T00:56:55.747-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:57:02.238-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:57:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:57:26.307-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588ed5c5cf15934537a9f5bc') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485755846127), why: "doing balance round", ts: ObjectId('588ed5c69527cdec667c1493') } } gle1: { lastOp: Timestamp 1485755846000|5, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 15, writtenTo: null, err: null, waited: 15, ok: 1.0 } gle2: { lastOp: Timestamp 1485755815000|14, connectionId: 393608, updatedExisting: false, n: 0, syncMillis: 4, writtenTo: null, err: null, waited: 4, ok: 1.0 } 2017-01-30T00:57:26.313-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-30T00:57:26.313-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:57:32.418-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:57:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:57:32.418-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-30T00:57:32.487-0500 [LockPinger] handled late remove of old distributed lock with ts 588ed5c69527cdec667c1493 2017-01-30T00:57:50.729-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ed5de9527cdec667c1494 2017-01-30T00:57:51.280-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:57:57.485-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ed5e59527cdec667c1495 2017-01-30T00:57:58.124-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:58:02.646-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:58:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:58:10.707-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ed5f29527cdec667c1496 2017-01-30T00:58:11.350-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:58:32.252-0500 [conn2189] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T00:58:32.916-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:58:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:58:35.864-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ed60b9527cdec667c1497 2017-01-30T00:58:36.574-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T00:58:54.863-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T00:58:54.863-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T00:59:03.144-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:59:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T00:59:33.388-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 00:59:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:00:03.578-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:00:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:00:33.864-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:00:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:00:38.233-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588ed6842cf29185e4b13b26') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485756038101), why: "doing balance round", ts: ObjectId('588ed6869527cdec667c1499') } } gle1: { lastOp: Timestamp 1485756038000|6, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 18, writtenTo: null, err: null, waited: 18, ok: 1.0 } gle2: { lastOp: Timestamp 1485755916000|20, connectionId: 393608, updatedExisting: false, n: 0, syncMillis: 14, writtenTo: null, err: null, waited: 14, ok: 1.0 } 2017-01-30T01:00:38.242-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-30T01:00:38.378-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ed6869527cdec667c1499 2017-01-30T01:00:39.086-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:01:04.164-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:01:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:01:09.755-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ed6a59527cdec667c149a 2017-01-30T01:01:10.462-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:01:34.414-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:01:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:01:41.048-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588ed6c43d24f1ca9d107832') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485756100904), why: "doing balance round", ts: ObjectId('588ed6c49527cdec667c149b') } } gle1: { lastOp: Timestamp 1485756100000|20, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 13, writtenTo: null, err: null, waited: 13, ok: 1.0 } gle2: { lastOp: Timestamp 1485756070000|9, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 34, writtenTo: null, err: null, waited: 34, ok: 1.0 } 2017-01-30T01:01:41.059-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-30T01:01:41.194-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ed6c49527cdec667c149b 2017-01-30T01:01:41.760-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:01:54.330-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ed6d19527cdec667c149c 2017-01-30T01:01:54.986-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:02:04.693-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:02:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:02:19.545-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ed6eb9527cdec667c149d 2017-01-30T01:02:20.323-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:02:26.816-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ed6f29527cdec667c149e 2017-01-30T01:02:27.493-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:02:34.927-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:02:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:02:45.959-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T01:02:45.959-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T01:03:05.085-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:03:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:03:16.445-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T01:03:16.445-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T01:03:22.704-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T01:03:22.704-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T01:03:32.147-0500 [conn2190] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T01:03:35.381-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:03:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:03:59.491-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ed74f9527cdec667c14a2 2017-01-30T01:04:00.090-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:04:05.747-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:04:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:04:24.724-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ed7689527cdec667c14a3 2017-01-30T01:04:25.531-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:04:36.039-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:04:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:04:37.927-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T01:04:37.927-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T01:05:06.365-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:05:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:05:36.567-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:05:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:06:06.855-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:06:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:06:37.129-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:06:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:07:07.389-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:07:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:07:37.668-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:07:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:08:07.812-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:08:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:08:32.413-0500 [conn2191] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T01:08:38.170-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:08:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:09:08.385-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:09:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:09:38.717-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:09:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:10:09.024-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:10:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:10:39.300-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:10:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:11:09.558-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:11:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:11:39.771-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:11:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:12:09.922-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:12:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:12:40.220-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:12:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:13:10.595-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:13:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:13:32.169-0500 [conn2192] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T01:13:40.869-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:13:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:14:11.144-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:14:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:14:41.440-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:14:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:15:11.621-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:15:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:15:41.915-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:15:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:16:12.199-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:16:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:16:42.400-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:16:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:17:12.577-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:17:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:17:42.904-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:17:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:18:13.105-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:18:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:18:32.289-0500 [conn2193] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T01:18:43.609-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:18:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:19:13.904-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:19:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:19:44.201-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:19:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:20:14.555-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:20:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:20:20.109-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588edb239527cdec667c14a5 2017-01-30T01:20:20.709-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:20:32.972-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588edb309527cdec667c14a6 2017-01-30T01:20:33.581-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:20:44.827-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:20:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:20:58.085-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T01:20:58.085-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T01:21:15.141-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:21:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:21:28.734-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588edb689527cdec667c14a8 2017-01-30T01:21:29.385-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:21:41.880-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588edb759527cdec667c14a9 2017-01-30T01:21:42.584-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:21:45.420-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:21:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:22:00.964-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T01:22:00.964-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T01:22:15.704-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:22:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:22:46.014-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:22:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:23:16.342-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:23:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:23:32.387-0500 [conn2194] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T01:23:38.447-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T01:23:38.447-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T01:23:44.820-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588edbf09527cdec667c14ac 2017-01-30T01:23:45.483-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:23:46.615-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:23:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:24:03.991-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588edc039527cdec667c14ad 2017-01-30T01:24:04.692-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:24:16.977-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:24:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:24:17.014-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T01:24:17.014-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T01:24:47.333-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:24:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:25:17.624-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:25:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:25:47.803-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:25:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:25:54.398-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588edc716dca7bf37970cb84') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485757554271), why: "doing balance round", ts: ObjectId('588edc729527cdec667c14af') } } gle1: { lastOp: Timestamp 1485757554000|8, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 6, writtenTo: null, err: null, waited: 6, ok: 1.0 } gle2: { lastOp: Timestamp 1485757444000|22, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 26, writtenTo: null, err: null, waited: 26, ok: 1.0 } 2017-01-30T01:25:54.408-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-30T01:25:54.577-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588edc729527cdec667c14af 2017-01-30T01:25:55.173-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:26:01.389-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588edc799527cdec667c14b0 2017-01-30T01:26:01.947-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:26:18.063-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:26:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:26:44.857-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T01:26:44.858-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T01:26:48.291-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:26:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:26:51.004-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T01:26:51.004-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T01:27:18.587-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:27:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:27:27.662-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588edccf9527cdec667c14b3 2017-01-30T01:27:28.256-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:27:34.577-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588edcd69527cdec667c14b4 2017-01-30T01:27:35.246-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:27:48.942-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:27:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:28:06.156-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588edcf59527cdec667c14b5 2017-01-30T01:28:06.786-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:28:19.215-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:28:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:28:31.335-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588edd0f9527cdec667c14b6 2017-01-30T01:28:32.136-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:28:32.161-0500 [conn2195] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T01:28:38.508-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588edd169527cdec667c14b7 2017-01-30T01:28:39.207-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:28:49.482-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:28:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:29:19.770-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:29:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:29:50.096-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:29:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:29:58.362-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588edd669527cdec667c14b8 2017-01-30T01:29:58.993-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:30:20.461-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:30:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:30:29.640-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588edd859527cdec667c14b9 2017-01-30T01:30:30.300-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:30:50.724-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:30:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:30:54.834-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588edd9e9527cdec667c14ba 2017-01-30T01:30:55.471-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:31:20.033-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588eddb79527cdec667c14bb 2017-01-30T01:31:20.666-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:31:21.026-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:31:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:31:33.197-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588eddc49527cdec667c14bc 2017-01-30T01:31:33.947-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:31:46.273-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588eddd29527cdec667c14bd 2017-01-30T01:31:46.908-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:31:51.318-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:31:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:32:11.500-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588eddeb9527cdec667c14be 2017-01-30T01:32:12.203-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:32:18.665-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588eddf29527cdec667c14bf 2017-01-30T01:32:19.390-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:32:21.592-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:32:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:32:31.806-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588eddff9527cdec667c14c0 2017-01-30T01:32:32.371-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:32:51.943-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:32:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:33:22.202-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:33:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:33:32.329-0500 [conn2196] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T01:33:45.391-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T01:33:45.392-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T01:33:52.539-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:33:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:34:15.848-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T01:34:15.849-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T01:34:22.736-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:34:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:34:40.447-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T01:34:40.447-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T01:34:46.699-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T01:34:46.699-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T01:34:53.018-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:34:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:35:17.176-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T01:35:17.176-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T01:35:23.372-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:35:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:35:53.561-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:35:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:35:53.883-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588edec99527cdec667c14c6 2017-01-30T01:35:54.510-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:36:23.841-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:36:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:36:25.115-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T01:36:25.115-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T01:36:31.459-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T01:36:31.460-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T01:36:54.136-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:36:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:36:56.108-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588edf079527cdec667c14c9 2017-01-30T01:36:56.777-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:37:09.182-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588edf149527cdec667c14ca 2017-01-30T01:37:09.808-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:37:24.400-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:37:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:37:34.244-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T01:37:34.244-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T01:37:54.756-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:37:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:37:58.660-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588edf45cf2a21eac5a7bc28') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485758278521), why: "doing balance round", ts: ObjectId('588edf469527cdec667c14cc') } } gle1: { lastOp: Timestamp 1485758278000|13, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 29, writtenTo: null, err: null, waited: 29, ok: 1.0 } gle2: { lastOp: Timestamp 1485758229000|8, connectionId: 393608, updatedExisting: false, n: 0, syncMillis: 28, writtenTo: null, err: null, waited: 28, ok: 1.0 } 2017-01-30T01:37:58.669-0500 [Balancer] lock update won, completing lock propagation for 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' 2017-01-30T01:37:58.802-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588edf469527cdec667c14cc 2017-01-30T01:37:59.574-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:38:05.831-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588edf4d9527cdec667c14cd 2017-01-30T01:38:06.458-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:38:12.702-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T01:38:12.702-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T01:38:25.026-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:38:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:38:32.205-0500 [conn2197] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T01:38:37.128-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T01:38:37.128-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T01:38:43.393-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T01:38:43.393-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T01:38:55.220-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:38:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:39:25.421-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:39:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:39:38.211-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T01:39:38.211-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T01:39:55.759-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:39:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:40:02.836-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588edfc29527cdec667c14d2 2017-01-30T01:40:03.543-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:40:26.021-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:40:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:40:56.290-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:40:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:40:58.212-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T01:40:58.212-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T01:41:16.623-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T01:41:16.623-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T01:41:26.558-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:41:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:41:56.837-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:41:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:41:59.489-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ee0379527cdec667c14d5 2017-01-30T01:42:00.154-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:42:27.137-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:42:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:42:48.856-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T01:42:48.856-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T01:42:57.515-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:42:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:43:07.172-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T01:43:07.172-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T01:43:27.801-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:43:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:43:32.195-0500 [conn2198] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T01:43:55.988-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T01:43:55.988-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T01:43:58.072-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:43:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:44:20.426-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T01:44:20.426-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T01:44:28.359-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:44:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:44:32.766-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T01:44:32.766-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T01:44:51.110-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T01:44:51.110-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T01:44:58.552-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:44:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:45:28.699-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:45:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:45:39.847-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T01:45:39.847-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T01:45:59.017-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:45:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:46:22.561-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T01:46:22.561-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T01:46:28.723-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588ee143f2367042e84ec92b') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485758788622), why: "doing balance round", ts: ObjectId('588ee1449527cdec667c14de') } } gle1: { lastOp: Timestamp 1485758788000|28, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 8, writtenTo: null, err: null, waited: 8, ok: 1.0 } gle2: { lastOp: Timestamp 1485758520000|8, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 6, writtenTo: null, err: null, waited: 6, ok: 1.0 } 2017-01-30T01:46:28.731-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-30T01:46:28.731-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T01:46:29.256-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:46:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:46:29.256-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-30T01:46:29.394-0500 [LockPinger] handled late remove of old distributed lock with ts 588ee1449527cdec667c14de 2017-01-30T01:46:59.652-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:46:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:47:30.021-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:47:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:48:00.291-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:48:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:48:30.406-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T01:48:30.406-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T01:48:30.787-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:48:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:48:32.259-0500 [conn2199] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T01:49:00.996-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:49:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:49:25.191-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T01:49:25.191-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T01:49:31.232-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:49:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:49:55.821-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ee2139527cdec667c14e1 2017-01-30T01:49:56.555-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:50:01.477-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:50:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:50:21.130-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ee22c9527cdec667c14e2 2017-01-30T01:50:21.859-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:50:31.740-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:50:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:50:58.585-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ee2529527cdec667c14e3 2017-01-30T01:50:59.250-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:51:01.900-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:51:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:51:32.173-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:51:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:51:54.093-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ee2899527cdec667c14e4 2017-01-30T01:51:54.801-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:52:02.470-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:52:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:52:32.756-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:52:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:53:03.047-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:53:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:53:19.901-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T01:53:19.901-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T01:53:32.338-0500 [conn2200] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T01:53:33.295-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:53:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:53:50.617-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ee2fe9527cdec667c14e6 2017-01-30T01:53:51.316-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:54:03.645-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:54:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:54:15.710-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T01:54:15.710-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T01:54:21.902-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T01:54:21.902-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T01:54:33.989-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:54:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:54:34.100-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T01:54:34.101-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T01:54:46.458-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T01:54:46.458-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T01:54:52.642-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T01:54:52.642-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T01:55:04.279-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:55:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:55:34.621-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:55:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:55:53.619-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T01:55:53.619-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T01:56:04.950-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:56:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:56:12.236-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ee38b9527cdec667c14ed 2017-01-30T01:56:12.989-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:56:19.183-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T01:56:19.183-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T01:56:25.408-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T01:56:25.408-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T01:56:35.232-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:56:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:56:37.681-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T01:56:37.681-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T01:56:43.883-0500 [Balancer] warning: distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383 did not propagate properly. :: caused by :: 8017 update not consistent ns: config.locks query: { _id: "balancer", state: 0, ts: ObjectId('588ee3aa45ec1b68d32625c0') } update: { $set: { state: 1, who: "its-a51.white.xxx.com:4356:1484950181:1804289383:Balancer:846930886", process: "its-a51.white.xxx.com:4356:1484950181:1804289383", when: new Date(1485759403748), why: "doing balance round", ts: ObjectId('588ee3ab9527cdec667c14f1') } } gle1: { lastOp: Timestamp 1485759403000|18, connectionId: 21778, updatedExisting: true, n: 1, syncMillis: 18, writtenTo: null, err: null, waited: 18, ok: 1.0 } gle2: { lastOp: Timestamp 1485759372000|28, connectionId: 6379656, updatedExisting: false, n: 0, syncMillis: 33, writtenTo: null, err: null, waited: 33, ok: 1.0 } 2017-01-30T01:56:43.891-0500 [Balancer] lock update lost, lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' not propagated. 2017-01-30T01:56:43.892-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T01:56:50.275-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ee3b29527cdec667c14f2 2017-01-30T01:56:50.967-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:57:05.558-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:57:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:57:05.558-0500 [LockPinger] trying to delete 1 old lock entries for process its-a51.white.xxx.com:4356:1484950181:1804289383 2017-01-30T01:57:05.767-0500 [LockPinger] handled late remove of old distributed lock with ts 588ee3ab9527cdec667c14f1 2017-01-30T01:57:27.637-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ee3d79527cdec667c14f3 2017-01-30T01:57:28.367-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:57:36.063-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:57:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:57:52.936-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ee3f09527cdec667c14f4 2017-01-30T01:57:53.633-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:58:00.030-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ee3f79527cdec667c14f5 2017-01-30T01:58:00.660-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:58:06.321-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:58:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:58:25.252-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ee4109527cdec667c14f6 2017-01-30T01:58:25.979-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:58:32.237-0500 [conn2201] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T01:58:36.635-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:58:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:58:38.409-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' acquired, ts : 588ee41e9527cdec667c14f7 2017-01-30T01:58:39.040-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' unlocked. 2017-01-30T01:59:06.916-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:59:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T01:59:15.614-0500 [Balancer] could not acquire lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' (another update won) 2017-01-30T01:59:15.614-0500 [Balancer] distributed lock 'balancer/its-a51.white.xxx.com:4356:1484950181:1804289383' was not acquired. 2017-01-30T01:59:37.835-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 01:59:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:00:08.095-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:00:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:00:38.453-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:00:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:01:08.730-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:01:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:01:39.142-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:01:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:02:09.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:02:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:02:39.618-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:02:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:03:09.839-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:03:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:03:32.197-0500 [conn2202] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T02:03:40.028-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:03:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:04:10.369-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:04:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:04:40.632-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:04:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:05:10.871-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:05:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:05:41.142-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:05:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:06:11.461-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:06:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:06:41.743-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:06:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:07:12.166-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:07:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:07:42.472-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:07:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:08:12.739-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:08:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:08:32.324-0500 [conn2203] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T02:08:43.025-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:08:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:09:13.302-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:09:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:09:43.571-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:09:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:10:13.965-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:10:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:10:44.240-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:10:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:11:14.517-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:11:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:11:44.828-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:11:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:12:15.005-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:12:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:12:45.205-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:12:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:13:15.386-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:13:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:13:32.115-0500 [conn2204] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T02:13:45.524-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:13:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:14:15.717-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:14:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:14:45.984-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:14:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:15:16.266-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:15:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:15:46.605-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:15:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:16:16.875-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:16:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:16:47.152-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:16:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:17:17.441-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:17:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:17:47.582-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:17:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:18:17.951-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:18:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:18:32.194-0500 [conn2205] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T02:18:48.132-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:18:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:19:18.417-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:19:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:19:48.687-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:19:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:20:18.980-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:20:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:20:49.189-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:20:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:21:19.452-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:21:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:21:49.735-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:21:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:22:20.082-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:22:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:22:50.299-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:22:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:23:20.576-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:23:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:23:32.134-0500 [conn2206] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T02:23:50.913-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:23:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:24:21.166-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:24:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:24:51.343-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:24:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:25:21.663-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:25:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:25:51.844-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:25:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:26:22.099-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:26:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:26:52.333-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:26:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:27:22.614-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:27:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:27:52.900-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:27:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:28:23.208-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:28:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:28:32.339-0500 [conn2207] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T02:28:53.487-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:28:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:29:23.909-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:29:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:29:54.217-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:29:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:30:24.409-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:30:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:30:54.705-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:30:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:31:24.899-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:31:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:31:55.097-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:31:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:32:25.356-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:32:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:32:55.674-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:32:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:33:25.868-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:33:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:33:32.237-0500 [conn2208] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T02:33:56.143-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:33:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:34:26.433-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:34:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:34:56.723-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:34:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:35:26.901-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:35:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:35:57.288-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:35:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:36:27.588-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:36:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:36:57.863-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:36:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:37:28.052-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:37:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:37:58.319-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:37:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:38:28.645-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:38:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:38:32.125-0500 [conn2209] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T02:38:59.033-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:38:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:39:29.306-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:39:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:39:59.622-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:39:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:40:29.902-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:40:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:41:00.116-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:40:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:41:30.257-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:41:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:42:00.684-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:42:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:42:30.974-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:42:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:43:01.250-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:43:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:43:31.549-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:43:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:43:32.310-0500 [conn2210] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T02:44:01.839-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:44:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:44:32.117-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:44:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:45:02.401-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:45:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:45:32.684-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:45:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:46:02.945-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:46:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:46:33.193-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:46:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:47:03.451-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:47:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:47:33.707-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:47:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:48:04.043-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:48:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:48:32.183-0500 [conn2211] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T02:48:34.309-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:48:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:49:04.633-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:49:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:49:34.979-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:49:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:50:05.202-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:50:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:50:35.385-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:50:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:51:05.690-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:51:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:51:35.984-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:51:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:52:06.264-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:52:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:52:36.658-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:52:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:53:06.912-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:53:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:53:32.248-0500 [conn2212] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T02:53:37.184-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:53:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:54:07.525-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:54:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:54:37.806-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:54:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:55:08.157-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:55:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:55:38.460-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:55:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:56:08.822-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:56:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:56:38.987-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:56:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:57:09.146-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:57:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:57:39.399-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:57:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:58:09.677-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:58:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:58:32.152-0500 [conn2213] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T02:58:40.052-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:58:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:59:10.325-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:59:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T02:59:40.774-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 02:59:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:00:11.078-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:00:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:00:41.357-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:00:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:01:11.583-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:01:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:01:41.976-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:01:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:02:12.271-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:02:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:02:42.524-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:02:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:03:12.795-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:03:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:03:32.310-0500 [conn2214] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T03:03:43.083-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:03:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:04:13.360-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:04:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:04:43.577-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:04:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:05:13.978-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:05:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:05:44.272-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:05:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:06:14.545-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:06:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:06:44.824-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:06:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:07:15.120-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:07:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:07:45.416-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:07:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:08:15.731-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:08:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:08:32.226-0500 [conn2215] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T03:08:46.040-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:08:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:09:16.291-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:09:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:09:46.562-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:09:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:10:16.852-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:10:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:10:47.078-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:10:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:11:17.420-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:11:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:11:47.567-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:11:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:12:17.859-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:12:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:12:48.129-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:12:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:13:18.397-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:13:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:13:32.294-0500 [conn2216] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T03:13:48.663-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:13:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:14:18.807-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:14:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:14:49.100-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:14:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:15:19.332-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:15:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:15:49.593-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:15:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:16:19.765-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:16:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:16:49.999-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:16:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:17:20.479-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:17:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:17:50.747-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:17:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:18:20.970-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:18:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:18:32.273-0500 [conn2217] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T03:18:51.314-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:18:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:19:21.699-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:19:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:19:51.874-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:19:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:20:22.097-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:20:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:20:52.284-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:20:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:21:22.560-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:21:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:21:52.843-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:21:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:22:23.054-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:22:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:22:53.344-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:22:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:23:23.618-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:23:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:23:32.178-0500 [conn2218] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T03:23:53.797-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:23:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:24:24.178-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:24:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:24:54.464-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:24:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:25:24.650-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:25:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:25:54.810-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:25:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:26:25.225-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:26:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:26:55.365-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:26:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:27:25.497-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:27:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:27:55.780-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:27:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:28:26.048-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:28:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:28:32.136-0500 [conn2219] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T03:28:56.345-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:28:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:29:26.670-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:29:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:29:57.080-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:29:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:30:27.263-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:30:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:30:57.470-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:30:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:31:27.758-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:31:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:31:57.973-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:31:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:32:28.406-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:32:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:32:58.638-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:32:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:33:28.905-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:33:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:33:32.117-0500 [conn2220] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T03:33:59.208-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:33:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:34:29.487-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:34:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:34:59.762-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:34:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:35:30.007-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:35:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:36:00.186-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:36:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:36:30.458-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:36:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:37:00.759-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:37:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:37:30.959-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:37:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:38:01.243-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:38:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:38:31.659-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:38:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:38:32.257-0500 [conn2221] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T03:39:01.920-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:39:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:39:32.207-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:39:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:40:02.563-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:40:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:40:32.886-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:40:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:41:03.172-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:41:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:41:33.355-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:41:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:42:03.500-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:42:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:42:33.781-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:42:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:43:04.064-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:43:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:43:32.307-0500 [conn2222] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T03:43:34.291-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:43:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:44:04.707-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:44:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:44:35.008-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:44:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:45:05.265-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:45:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:45:35.523-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:45:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:46:05.853-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:46:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:46:36.011-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:46:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:47:06.283-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:47:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:47:36.538-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:47:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:48:06.822-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:48:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:48:32.222-0500 [conn2223] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T03:48:37.133-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:48:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:49:07.415-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:49:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:49:37.632-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:49:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:50:07.917-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:50:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:50:38.069-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:50:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:51:08.362-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:51:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:51:38.700-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:51:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:52:08.958-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:52:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:52:39.128-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:52:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:53:09.346-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:53:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:53:32.117-0500 [conn2224] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T03:53:39.724-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:53:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:54:10.173-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:54:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:54:40.583-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:54:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:55:10.889-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:55:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:55:41.145-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:55:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:56:11.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:56:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:56:41.847-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:56:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:57:12.238-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:57:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:57:42.585-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:57:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:58:12.743-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:58:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:58:32.188-0500 [conn2225] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T03:58:43.027-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:58:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:59:13.308-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:59:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T03:59:43.496-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 03:59:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:00:13.847-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:00:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:00:44.122-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:00:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:01:14.400-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:01:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:01:44.687-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:01:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:02:14.950-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:02:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:02:45.232-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:02:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:03:15.551-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:03:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:03:32.155-0500 [conn2226] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T04:03:45.885-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:03:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:04:16.214-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:04:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:04:46.504-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:04:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:05:16.677-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:05:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:05:46.964-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:05:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:06:17.320-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:06:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:06:47.592-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:06:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:07:17.857-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:07:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:07:48.141-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:07:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:08:18.332-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:08:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:08:32.250-0500 [conn2227] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T04:08:48.476-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:08:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:09:18.757-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:09:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:09:49.200-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:09:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:10:19.491-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:10:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:10:49.740-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:10:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:11:20.019-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:11:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:11:50.190-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:11:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:12:20.451-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:12:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:12:50.781-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:12:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:13:21.087-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:13:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:13:32.316-0500 [conn2228] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T04:13:51.366-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:13:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:14:21.656-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:14:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:14:51.948-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:14:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:15:22.090-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:15:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:15:52.432-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:15:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:16:22.631-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:16:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:16:52.915-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:16:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:17:23.198-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:17:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:17:53.675-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:17:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:18:23.947-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:18:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:18:32.300-0500 [conn2229] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T04:18:54.227-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:18:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:19:24.492-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:19:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:19:54.682-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:19:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:20:24.974-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:20:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:20:43.185-0500 [conn12] ChunkManager: time to load chunks for historyDb.History: 97ms sequenceNumber: 9 version: 3285|23||55c0dbaf5b591f0b0cfcee5f based on: 3285|21||55c0dbaf5b591f0b0cfcee5f 2017-01-30T04:20:55.256-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:20:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:21:25.518-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:21:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:21:55.682-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:21:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:22:25.819-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:22:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:22:56.105-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:22:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:23:26.260-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:23:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:23:32.099-0500 [conn2230] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T04:23:56.652-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:23:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:24:26.851-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:24:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:24:57.130-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:24:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:25:27.418-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:25:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:25:57.618-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:25:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:26:27.879-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:26:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:26:58.153-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:26:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:27:28.442-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:27:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:27:58.704-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:27:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:28:28.995-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:28:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:28:32.111-0500 [conn2231] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T04:28:59.313-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:28:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:29:29.492-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:29:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:29:59.783-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:29:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:30:30.050-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:30:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:31:00.311-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:31:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:31:30.612-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:31:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:32:00.940-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:32:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:32:31.140-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:32:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:33:01.388-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:33:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:33:31.605-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:33:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:33:32.215-0500 [conn2232] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T04:34:01.930-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:34:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:34:32.189-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:34:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:35:02.451-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:35:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:35:32.731-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:35:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:36:03.028-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:36:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:36:33.298-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:36:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:37:03.577-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:37:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:37:33.868-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:37:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:38:04.191-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:38:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:38:32.072-0500 [conn2233] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T04:38:34.336-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:38:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:39:04.678-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:39:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:39:34.954-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:39:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:40:05.288-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:40:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:40:35.580-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:40:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:41:05.859-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:41:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:41:36.125-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:41:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:42:06.457-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:42:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:42:36.713-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:42:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:43:07.008-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:43:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:43:32.153-0500 [conn2234] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T04:43:37.291-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:43:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:44:07.623-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:44:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:44:37.810-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:44:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:45:08.090-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:45:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:45:38.285-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:45:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:46:08.632-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:46:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:46:38.920-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:46:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:47:09.210-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:47:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:47:39.578-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:47:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:48:09.905-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:48:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:48:32.155-0500 [conn2235] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T04:48:40.053-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:48:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:49:10.377-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:49:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:49:40.567-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:49:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:50:10.944-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:50:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:50:41.209-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:50:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:51:11.429-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:51:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:51:41.688-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:51:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:52:11.969-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:52:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:52:42.147-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:52:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:53:12.475-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:53:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:53:32.265-0500 [conn2236] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T04:53:42.773-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:53:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:54:13.050-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:54:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:54:43.351-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:54:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:55:13.704-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:55:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:55:43.973-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:55:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:56:14.252-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:56:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:56:44.458-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:56:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:57:14.738-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:57:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:57:44.896-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:57:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:58:15.191-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:58:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:58:32.294-0500 [conn2237] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T04:58:45.443-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:58:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:59:15.926-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:59:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T04:59:46.161-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 04:59:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:00:16.630-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:00:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:00:46.959-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:00:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:01:17.248-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:01:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:01:47.551-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:01:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:02:17.822-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:02:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:02:48.112-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:02:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:03:18.385-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:03:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:03:32.303-0500 [conn2238] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T05:03:48.706-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:03:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:04:19.109-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:04:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:04:49.410-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:04:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:05:19.635-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:05:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:05:49.850-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:05:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:06:20.114-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:06:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:06:50.393-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:06:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:07:20.681-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:07:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:07:50.975-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:07:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:08:21.255-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:08:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:08:32.176-0500 [conn2239] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T05:08:51.549-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:08:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:09:21.881-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:09:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:09:52.113-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:09:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:10:22.284-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:10:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:10:52.548-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:10:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:11:22.721-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:11:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:11:53.024-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:11:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:12:23.318-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:12:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:12:53.644-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:12:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:13:23.952-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:13:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:13:32.249-0500 [conn2240] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T05:13:54.225-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:13:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:14:24.560-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:14:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:14:54.866-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:14:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:15:25.257-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:15:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:15:55.525-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:15:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:16:25.769-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:16:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:16:56.046-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:16:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:17:26.326-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:17:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:17:56.624-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:17:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:18:26.809-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:18:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:18:32.138-0500 [conn2241] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T05:18:57.158-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:18:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:19:27.537-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:19:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:19:57.805-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:19:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:20:28.071-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:20:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:20:58.334-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:20:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:21:28.611-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:21:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:21:58.893-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:21:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:22:29.239-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:22:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:22:59.506-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:22:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:23:29.841-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:23:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:23:32.103-0500 [conn2242] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T05:23:59.981-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:23:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:24:30.350-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:24:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:25:00.651-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:25:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:25:31.004-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:25:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:26:01.138-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:26:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:26:31.327-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:26:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:27:01.580-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:27:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:27:31.863-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:27:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:28:02.242-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:28:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:28:32.344-0500 [conn2243] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T05:28:32.581-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:28:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:29:02.737-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:29:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:29:33.087-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:29:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:30:03.290-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:30:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:30:33.560-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:30:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:31:03.808-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:31:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:31:34.207-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:31:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:32:04.402-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:32:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:32:34.684-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:32:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:33:05.001-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:33:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:33:32.311-0500 [conn2244] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T05:33:35.150-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:33:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:34:05.420-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:34:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:34:35.691-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:34:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:35:05.933-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:35:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:35:36.202-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:35:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:36:06.495-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:36:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:36:36.763-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:36:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:37:07.056-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:37:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:37:37.429-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:37:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:38:07.627-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:38:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:38:32.140-0500 [conn2245] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T05:38:37.898-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:38:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:39:08.135-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:39:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:39:38.276-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:39:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:40:08.589-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:40:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:40:38.870-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:40:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:41:09.082-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:41:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:41:39.272-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:41:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:42:09.543-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:42:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:42:39.792-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:42:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:43:09.929-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:43:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:43:32.390-0500 [conn2246] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T05:43:40.197-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:43:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:44:10.447-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:44:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:44:40.696-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:44:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:45:10.982-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:45:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:45:41.245-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:45:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:46:11.387-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:46:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:46:41.652-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:46:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:47:12.037-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:47:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:47:42.348-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:47:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:48:12.678-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:48:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:48:32.296-0500 [conn2247] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T05:48:43.136-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:48:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:49:13.291-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:49:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:49:43.608-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:49:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:50:13.879-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:50:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:50:44.104-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:50:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:51:14.326-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:51:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:51:44.631-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:51:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:52:14.963-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:52:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:52:45.162-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:52:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:53:15.494-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:53:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:53:32.299-0500 [conn2248] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T05:53:45.758-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:53:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:54:16.037-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:54:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:54:46.396-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:54:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:55:16.696-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:55:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:55:46.862-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:55:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:56:17.153-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:56:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:56:47.427-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:56:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:57:17.704-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:57:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:57:47.883-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:57:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:58:18.171-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:58:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:58:32.210-0500 [conn2249] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T05:58:48.327-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:58:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:59:18.602-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:59:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T05:59:48.859-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 05:59:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:00:19.126-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:00:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:00:49.331-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:00:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:01:19.465-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:01:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:01:49.846-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:01:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:02:20.139-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:02:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:02:50.387-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:02:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:03:20.521-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:03:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:03:32.239-0500 [conn2250] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T06:03:50.800-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:03:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:04:20.994-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:04:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:04:51.302-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:04:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:05:21.593-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:05:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:05:51.753-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:05:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:06:21.977-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:06:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:06:52.146-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:06:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:07:22.401-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:07:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:07:52.658-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:07:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:08:22.794-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:08:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:08:32.283-0500 [conn2251] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T06:08:53.042-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:08:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:09:23.312-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:09:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:09:53.543-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:09:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:10:23.690-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:10:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:10:54.036-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:10:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:11:24.309-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:11:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:11:54.654-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:11:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:12:24.980-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:12:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:12:55.254-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:12:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:13:25.475-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:13:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:13:32.193-0500 [conn2252] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T06:13:55.741-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:13:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:14:26.007-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:14:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:14:56.268-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:14:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:15:26.528-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:15:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:15:56.833-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:15:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:16:27.041-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:16:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:16:57.363-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:16:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:17:27.621-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:17:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:17:57.922-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:17:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:18:28.239-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:18:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:18:32.152-0500 [conn2253] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T06:18:58.528-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:18:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:19:28.818-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:19:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:19:59.106-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:19:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:20:29.370-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:20:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:20:59.773-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:20:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:21:30.123-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:21:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:22:00.404-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:22:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:22:30.679-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:22:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:23:00.936-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:23:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:23:31.428-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:23:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:23:32.112-0500 [conn2254] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T06:24:01.868-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:24:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:24:32.145-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:24:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:25:02.425-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:25:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:25:32.693-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:25:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:26:02.989-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:26:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:26:33.279-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:26:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:27:03.624-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:27:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:27:33.989-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:27:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:28:04.278-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:28:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:28:32.112-0500 [conn2255] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T06:28:34.524-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:28:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:29:04.673-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:29:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:29:34.933-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:29:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:30:05.194-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:30:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:30:35.365-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:30:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:31:05.624-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:31:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:31:35.839-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:31:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:32:06.125-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:32:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:32:36.498-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:32:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:33:06.701-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:33:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:33:32.179-0500 [conn2256] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T06:33:36.999-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:33:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:34:07.375-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:34:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:34:37.636-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:34:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:35:07.829-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:35:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:35:38.028-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:35:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:36:08.238-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:36:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:36:38.503-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:36:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:37:08.779-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:37:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:37:38.971-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:37:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:38:09.151-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:38:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:38:32.240-0500 [conn2257] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T06:38:39.372-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:38:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:39:09.680-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:39:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:39:39.947-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:39:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:40:10.095-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:40:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:40:40.286-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:40:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:41:10.616-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:41:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:41:40.877-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:41:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:42:11.173-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:42:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:42:41.474-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:42:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:43:11.772-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:43:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:43:32.219-0500 [conn2258] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T06:43:42.057-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:43:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:44:12.324-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:44:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:44:42.592-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:44:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:45:12.772-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:45:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:45:43.052-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:45:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:46:13.212-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:46:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:46:43.510-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:46:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:47:13.676-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:47:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:47:43.942-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:47:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:48:14.258-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:48:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:48:32.278-0500 [conn2259] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T06:48:44.534-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:48:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:49:14.810-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:49:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:49:45.344-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:49:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:50:15.572-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:50:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:50:45.976-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:50:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:51:16.169-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:51:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:51:46.558-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:51:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:52:16.709-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:52:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:52:46.988-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:52:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:53:17.256-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:53:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:53:32.301-0500 [conn2260] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T06:53:47.460-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:53:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:54:17.742-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:54:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:54:48.105-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:54:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:55:18.375-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:55:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:55:48.657-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:55:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:56:18.818-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:56:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:56:49.020-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:56:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:57:19.383-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:57:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:57:49.740-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:57:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:58:19.980-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:58:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:58:32.307-0500 [conn2261] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T06:58:50.251-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:58:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:59:20.530-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:59:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T06:59:50.877-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 06:59:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:00:21.052-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:00:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:00:51.339-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:00:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:01:21.688-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:01:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:01:51.973-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:01:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:02:22.166-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:02:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:02:52.566-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:02:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:03:22.785-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:03:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:03:32.251-0500 [conn2262] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T07:03:53.064-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:03:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:04:23.384-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:04:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:04:53.651-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:04:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:05:23.942-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:05:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:05:54.100-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:05:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:06:24.486-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:06:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:06:54.768-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:06:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:07:25.017-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:07:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:07:55.274-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:07:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:08:25.526-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:08:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:08:32.153-0500 [conn2263] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T07:08:55.756-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:08:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:09:25.983-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:09:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:09:56.322-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:09:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:10:26.614-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:10:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:10:56.894-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:10:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:11:27.184-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:11:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:11:57.464-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:11:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:12:27.763-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:12:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:12:58.100-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:12:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:13:28.334-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:13:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:13:32.321-0500 [conn2264] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T07:13:58.609-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:13:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:14:28.883-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:14:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:14:59.212-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:14:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:15:29.360-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:15:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:15:59.713-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:15:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:16:30.092-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:16:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:17:00.293-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:17:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:17:30.684-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:17:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:18:00.987-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:18:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:18:31.313-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:18:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:18:32.168-0500 [conn2265] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T07:19:01.611-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:19:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:19:31.814-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:19:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:20:02.133-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:20:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:20:32.427-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:20:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:21:02.582-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:21:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:21:32.923-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:21:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:22:03.238-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:22:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:22:33.415-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:22:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:23:03.684-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:23:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:23:32.229-0500 [conn2266] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T07:23:33.973-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:23:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:24:04.277-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:24:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:24:34.663-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:24:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:25:04.918-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:25:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:25:35.221-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:25:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:26:05.582-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:26:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:26:35.800-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:26:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:27:06.067-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:27:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:27:36.292-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:27:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:28:06.597-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:28:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:28:32.288-0500 [conn2267] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T07:28:36.739-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:28:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:29:06.990-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:29:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:29:37.258-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:29:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:30:07.418-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:30:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:30:37.590-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:30:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:31:07.780-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:31:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:31:37.977-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:31:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:32:08.273-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:32:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:32:38.591-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:32:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:33:08.998-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:33:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:33:32.271-0500 [conn2268] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T07:33:39.271-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:33:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:34:09.604-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:34:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:34:39.761-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:34:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:35:10.041-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:35:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:35:40.370-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:35:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:36:10.745-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:36:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:36:41.033-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:36:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:37:11.298-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:37:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:37:41.605-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:37:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:38:11.786-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:38:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:38:32.308-0500 [conn2269] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T07:38:42.041-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:38:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:39:12.273-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:39:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:39:42.536-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:39:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:40:12.877-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:40:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:40:43.188-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:40:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:41:13.470-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:41:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:41:43.680-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:41:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:42:14.044-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:42:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:42:44.334-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:42:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:43:14.613-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:43:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:43:32.264-0500 [conn2270] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T07:43:44.814-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:43:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:44:15.071-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:44:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:44:45.385-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:44:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:45:15.663-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:45:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:45:45.953-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:45:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:46:16.190-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:46:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:46:46.360-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:46:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:47:16.525-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:47:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:47:46.791-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:47:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:48:17.188-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:48:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:48:32.216-0500 [conn2271] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T07:48:47.435-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:48:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:49:17.742-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:49:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:49:48.154-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:49:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:50:18.545-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:50:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:50:48.825-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:50:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:51:19.242-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:51:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:51:49.501-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:51:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:52:19.662-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:52:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:52:49.960-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:52:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:53:20.394-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:53:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:53:32.231-0500 [conn2272] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T07:53:50.719-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:53:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:54:20.870-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:54:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:54:51.003-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:54:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:55:21.197-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:55:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:55:51.486-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:55:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:56:21.755-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:56:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:56:52.044-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:56:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:57:22.328-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:57:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:57:52.788-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:57:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:58:22.952-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:58:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:58:32.278-0500 [conn2273] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T07:58:53.238-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:58:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:59:23.605-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:59:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T07:59:53.963-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 07:59:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:00:24.266-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:00:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:00:54.541-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:00:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:01:24.829-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:01:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:01:54.964-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:01:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:02:25.283-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:02:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:02:55.442-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:02:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:02:55.693-0500 [conn2274] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:02:55.894-0500 [conn2275] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:02:56.096-0500 [conn2276] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:02:56.298-0500 [conn2277] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:02:56.500-0500 [conn2278] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:02:56.752-0500 [conn2279] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:02:56.905-0500 [conn2280] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:02:57.009-0500 [conn2281] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:02:57.114-0500 [conn2282] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:03:23.214-0500 [conn2284] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:03:25.717-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:03:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:03:26.303-0500 [conn2294] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:03:26.310-0500 [conn2295] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:03:26.780-0500 [conn2321] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:03:26.811-0500 [conn2324] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:03:27.072-0500 [conn2334] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:03:28.759-0500 [conn2350] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:03:32.353-0500 [conn2352] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T08:03:33.049-0500 [conn2353] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:03:36.592-0500 [conn2354] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:03:47.290-0500 [conn2361] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:03:47.297-0500 [conn2362] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:03:52.098-0500 [conn2489] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:03:52.222-0500 [conn2493] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:03:52.427-0500 [conn2511] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:03:52.435-0500 [conn2513] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:03:53.416-0500 [conn2563] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:03:53.427-0500 [conn2564] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:03:55.998-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:03:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:03:57.534-0500 [conn2602] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:03:58.575-0500 [conn2646] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:03:59.027-0500 [conn2684] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:03:59.038-0500 [conn2685] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:04:00.447-0500 [conn2740] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:04:10.520-0500 [conn2826] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:04:11.608-0500 [conn2962] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:04:12.516-0500 [conn3006] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:04:12.654-0500 [conn3025] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:04:12.859-0500 [conn3039] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:04:13.078-0500 [conn3055] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:04:13.100-0500 [conn3060] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:04:13.115-0500 [conn3061] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:04:13.204-0500 [conn3068] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:04:13.431-0500 [conn3080] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:04:15.239-0500 [conn3196] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:04:15.821-0500 [conn3233] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:04:15.888-0500 [conn3240] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:04:15.960-0500 [conn3247] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:04:16.111-0500 [conn3258] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:04:16.825-0500 [conn3275] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:04:16.839-0500 [conn3277] AssertionException handling request, closing client connection: 17132 SSL handshake received but server is started without SSL support 2017-01-30T08:04:26.219-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:04:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:04:56.422-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:04:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:05:26.830-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:05:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:05:57.133-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:05:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:06:27.482-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:06:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:06:57.777-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:06:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:07:28.077-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:07:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:07:58.354-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:07:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:08:28.639-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:08:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:08:32.279-0500 [conn3436] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T08:08:58.820-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:08:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:09:29.161-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:09:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:09:59.430-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:09:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:10:29.681-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:10:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:10:59.929-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:10:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:11:30.132-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:11:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:12:00.425-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:12:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:12:30.722-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:12:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:13:00.997-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:13:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:13:31.332-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:13:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:13:32.351-0500 [conn3437] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T08:14:01.572-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:14:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:14:31.702-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:14:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:15:02.014-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:15:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:15:32.389-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:15:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:16:02.645-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:16:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:16:32.971-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:16:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:17:03.273-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:17:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:17:33.580-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:17:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:18:03.861-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:18:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:18:32.327-0500 [conn3438] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T08:18:34.000-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:18:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:19:04.277-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:19:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:19:34.460-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:19:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:20:04.728-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:20:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:20:35.031-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:20:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:21:05.294-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:21:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:21:35.558-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:21:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:22:05.826-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:22:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:22:36.147-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:22:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:23:06.299-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:23:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:23:32.269-0500 [conn3439] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T08:23:36.547-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:23:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:24:06.821-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:24:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:24:37.174-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:24:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:25:07.449-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:25:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:25:37.724-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:25:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:26:07.919-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:26:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:26:38.209-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:26:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:27:08.481-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:27:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:27:38.644-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:27:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:28:08.947-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:28:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:28:32.411-0500 [conn3440] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T08:28:39.249-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:28:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:29:09.383-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:29:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:29:39.898-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:29:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:30:10.333-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:30:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:30:40.642-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:30:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:31:10.896-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:31:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:31:41.057-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:31:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:32:11.459-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:32:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:32:41.812-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:32:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:33:12.119-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:33:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:33:32.310-0500 [conn3441] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T08:33:42.259-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:33:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:34:12.537-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:34:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:34:42.838-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:34:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:35:13.113-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:35:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:35:43.492-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:35:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:36:13.648-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:36:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:36:43.919-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:36:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:37:14.115-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:37:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:37:44.409-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:37:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:38:14.826-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:38:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:38:32.263-0500 [conn3442] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T08:38:45.106-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:38:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:39:15.286-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:39:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:39:45.564-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:39:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:40:15.768-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:40:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:40:45.977-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:40:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:41:16.125-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:41:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:41:46.412-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:41:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:42:16.748-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:42:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:42:47.069-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:42:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:43:17.380-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:43:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:43:32.301-0500 [conn3443] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T08:43:47.689-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:43:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:44:17.981-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:44:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:44:48.211-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:44:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:45:18.552-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:45:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:45:48.936-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:45:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:46:19.268-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:46:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:46:49.542-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:46:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:47:19.973-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:47:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:47:50.248-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:47:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:48:20.536-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:48:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:48:32.124-0500 [conn3444] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T08:48:50.830-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:48:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:49:20.993-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:49:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:49:51.265-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:49:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:50:21.450-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:50:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:50:51.708-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:50:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:51:21.856-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:51:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:51:52.126-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:51:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:52:22.409-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:52:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:52:52.645-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:52:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:53:23.071-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:53:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:53:32.149-0500 [conn3445] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T08:53:53.559-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:53:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:54:23.860-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:54:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:54:54.124-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:54:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:55:24.392-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:55:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:55:54.743-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:55:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:56:24.958-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:56:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:56:55.346-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:56:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:57:25.600-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:57:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:57:55.827-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:57:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:58:26.183-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:58:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:58:32.250-0500 [conn3446] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T08:58:56.538-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:58:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:59:26.766-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:59:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T08:59:57.126-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 08:59:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:00:27.457-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:00:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:00:57.751-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:00:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:01:28.047-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:01:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:01:58.288-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:01:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:02:28.757-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:02:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:02:59.017-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:02:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:03:29.319-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:03:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:03:32.167-0500 [conn3447] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T09:03:59.775-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:03:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:04:29.974-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:04:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:05:00.166-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:04:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:05:30.392-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:05:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:06:00.760-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:06:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:06:30.971-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:06:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:07:01.447-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:07:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:07:31.746-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:07:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:08:01.958-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:08:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:08:32.074-0500 [conn3448] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T09:08:32.197-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:08:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:09:02.393-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:09:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:09:32.722-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:09:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:10:02.976-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:10:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:10:33.280-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:10:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:11:03.621-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:11:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:11:33.848-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:11:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:12:04.163-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:12:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:12:34.425-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:12:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:13:04.750-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:13:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:13:32.240-0500 [conn3449] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T09:13:35.063-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:13:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:14:05.368-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:14:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:14:35.618-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:14:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:15:05.770-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:15:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:15:36.063-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:15:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:16:06.324-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:16:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:16:36.742-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:16:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:17:06.915-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:17:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:17:37.159-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:17:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:18:07.571-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:18:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:18:32.173-0500 [conn3450] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T09:18:37.939-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:18:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:19:08.117-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:19:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:19:38.358-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:19:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:20:08.707-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:20:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:20:39.051-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:20:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:21:09.371-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:21:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:21:39.784-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:21:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:22:10.059-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:22:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:22:40.353-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:22:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:23:10.642-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:23:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:23:32.229-0500 [conn3451] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T09:23:40.930-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:23:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:24:11.235-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:24:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:24:41.557-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:24:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:25:11.714-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:25:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:25:42.005-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:25:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:26:12.286-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:26:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:26:42.626-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:26:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:27:12.844-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:27:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:27:43.140-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:27:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:28:13.327-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:28:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:28:32.294-0500 [conn3452] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T09:28:43.486-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:28:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:29:13.752-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:29:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:29:43.928-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:29:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:30:14.138-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:30:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:30:44.495-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:30:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:31:14.792-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:31:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:31:45.245-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:31:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:32:15.661-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:32:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:32:46.058-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:32:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:33:16.596-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:33:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:33:32.246-0500 [conn3453] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T09:33:46.871-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:33:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:34:17.094-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:34:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:34:47.439-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:34:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:35:17.629-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:35:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:35:47.898-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:35:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:36:18.122-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:36:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:36:48.324-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:36:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:37:18.614-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:37:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:37:48.845-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:37:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:38:19.148-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:38:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:38:32.168-0500 [conn3454] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T09:38:49.396-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:38:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:39:19.701-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:39:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:39:49.955-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:39:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:40:20.204-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:40:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:40:50.443-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:40:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:41:20.857-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:41:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:41:51.255-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:41:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:42:21.484-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:42:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:42:51.802-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:42:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:43:22.104-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:43:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:43:32.361-0500 [conn3455] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T09:43:52.496-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:43:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:44:22.815-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:44:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:44:53.100-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:44:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:45:23.275-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:45:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:45:53.617-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:45:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:46:23.957-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:46:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:46:54.186-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:46:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:47:24.651-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:47:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:47:54.900-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:47:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:48:25.189-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:48:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:48:32.234-0500 [conn3456] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T09:48:55.532-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:48:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:49:25.794-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:49:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:49:56.123-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:49:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:50:26.374-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:50:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:50:56.688-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:50:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:51:26.929-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:51:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:51:57.220-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:51:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:52:27.600-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:52:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:52:57.850-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:52:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:53:28.285-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:53:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:53:32.326-0500 [conn3457] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T09:53:58.586-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:53:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:54:28.752-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:54:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:54:59.055-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:54:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:55:29.387-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:55:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:55:59.719-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:55:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:56:30.058-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:56:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:57:00.299-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:57:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:57:30.534-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:57:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:58:00.933-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:58:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:58:31.169-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:58:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:58:32.387-0500 [conn3458] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T09:59:01.432-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:59:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T09:59:31.786-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 09:59:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:00:02.024-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:00:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:00:32.235-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:00:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:01:02.579-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:01:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:01:32.869-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:01:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:02:03.145-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:02:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:02:33.423-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:02:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:03:03.633-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:03:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:03:32.152-0500 [conn3459] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T10:03:33.967-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:03:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:04:04.121-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:04:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:04:34.478-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:04:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:05:04.702-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:05:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:05:35.018-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:05:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:06:05.400-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:06:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:06:35.553-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:06:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:07:05.815-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:07:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:07:35.994-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:07:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:08:06.491-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:08:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:08:32.238-0500 [conn3460] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T10:08:36.786-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:08:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:09:07.101-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:09:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:09:37.395-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:09:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:10:07.759-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:10:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:10:38.021-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:10:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:11:08.260-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:11:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:11:38.487-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:11:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:12:08.723-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:12:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:12:38.998-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:12:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:13:09.319-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:13:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:13:32.288-0500 [conn3461] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T10:13:39.572-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:13:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:14:09.838-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:14:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:14:40.057-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:14:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:15:10.292-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:15:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:15:40.564-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:15:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:16:10.779-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:16:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:16:41.020-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:16:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:17:11.263-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:17:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:17:41.423-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:17:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:18:11.712-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:18:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:18:32.285-0500 [conn3462] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T10:18:42.029-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:18:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:19:12.249-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:19:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:19:42.526-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:19:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:20:12.823-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:20:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:20:43.024-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:20:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:21:13.335-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:21:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:21:43.612-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:21:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:22:13.910-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:22:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:22:44.208-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:22:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:23:14.513-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:23:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:23:32.327-0500 [conn3463] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T10:23:44.773-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:23:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:24:15.105-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:24:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:24:45.498-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:24:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:25:15.746-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:25:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:25:46.190-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:25:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:26:16.481-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:26:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:26:46.770-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:26:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:27:17.003-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:27:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:27:47.271-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:27:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:28:17.641-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:28:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:28:32.161-0500 [conn3464] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T10:28:47.845-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:28:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:29:18.104-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:29:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:29:48.368-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:29:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:30:18.714-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:30:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:30:48.915-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:30:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:31:19.316-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:31:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:31:49.571-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:31:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:32:19.889-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:32:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:32:50.210-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:32:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:33:20.472-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:33:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:33:32.109-0500 [conn3465] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T10:33:50.631-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:33:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:34:20.862-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:34:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:34:51.238-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:34:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:35:21.386-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:35:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:35:51.668-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:35:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:36:21.935-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:36:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:36:52.332-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:36:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:37:22.656-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:37:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:37:52.937-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:37:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:38:23.130-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:38:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:38:32.120-0500 [conn3466] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T10:38:53.451-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:38:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:39:23.888-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:39:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:39:54.208-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:39:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:40:24.566-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:40:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:40:54.766-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:40:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:41:25.129-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:41:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:41:55.461-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:41:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:42:25.715-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:42:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:42:56.014-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:42:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:43:26.320-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:43:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:43:32.265-0500 [conn3467] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T10:43:56.595-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:43:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:44:26.745-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:44:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:44:56.927-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:44:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:45:27.289-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:45:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:45:57.553-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:45:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:46:28.055-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:46:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:46:58.330-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:46:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:47:28.626-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:47:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:47:58.784-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:47:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:48:28.989-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:48:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:48:32.377-0500 [conn3468] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T10:48:59.145-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:48:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:49:29.439-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:49:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:49:59.648-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:49:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:50:30.181-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:50:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:51:00.469-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:51:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:51:30.821-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:51:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:52:01.116-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:52:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:52:31.344-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:52:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:53:01.529-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:53:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:53:31.819-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:53:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:53:32.253-0500 [conn3469] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T10:54:02.106-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:54:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:54:32.443-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:54:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:55:02.738-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:55:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:55:33.088-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:55:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:56:03.239-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:56:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:56:33.545-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:56:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:57:03.925-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:57:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:57:34.208-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:57:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:58:04.512-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:58:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:58:32.367-0500 [conn3470] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T10:58:34.677-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:58:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:59:04.931-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:59:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T10:59:35.386-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 10:59:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:00:05.613-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:00:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:00:35.840-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:00:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:01:06.124-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:01:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:01:36.314-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:01:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:02:06.508-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:02:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:02:36.730-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:02:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:03:07.030-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:03:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:03:32.239-0500 [conn3471] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T11:03:37.432-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:03:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:04:07.788-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:04:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:04:38.051-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:04:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:05:08.255-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:05:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:05:38.616-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:05:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:06:09.031-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:06:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:06:39.343-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:06:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:07:09.623-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:07:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:07:40.023-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:07:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:08:10.279-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:08:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:08:32.224-0500 [conn3472] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T11:08:40.568-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:08:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:09:10.936-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:09:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:09:41.423-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:09:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:10:11.631-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:10:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:10:41.860-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:10:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:11:12.169-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:11:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:11:42.459-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:11:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:12:12.735-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:12:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:12:43.038-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:12:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:13:13.340-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:13:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:13:32.114-0500 [conn3473] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T11:13:43.669-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:13:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:14:14.114-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:14:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:14:44.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:14:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:15:14.757-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:15:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:15:45.086-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:15:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:16:15.364-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:16:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:16:45.596-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:16:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:17:15.823-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:17:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:17:46.104-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:17:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:18:16.468-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:18:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:18:32.177-0500 [conn3474] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T11:18:46.702-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:18:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:19:16.938-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:19:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:19:47.240-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:19:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:20:17.596-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:20:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:20:47.899-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:20:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:21:18.225-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:21:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:21:48.553-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:21:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:22:18.940-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:22:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:22:49.251-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:22:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:23:19.510-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:23:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:23:32.247-0500 [conn3475] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T11:23:49.802-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:23:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:24:19.957-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:24:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:24:50.185-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:24:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:25:20.476-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:25:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:25:50.633-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:25:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:26:21.031-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:26:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:26:51.496-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:26:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:27:21.867-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:27:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:27:52.131-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:27:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:28:22.410-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:28:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:28:52.793-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:28:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:29:11.120-0500 [conn3476] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T11:29:23.051-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:29:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:29:53.286-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:29:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:30:23.474-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:30:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:30:53.777-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:30:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:31:24.063-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:31:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:31:54.419-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:31:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:32:24.716-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:32:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:32:55.034-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:32:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:33:25.249-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:33:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:33:55.662-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:33:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:34:11.139-0500 [conn3477] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T11:34:25.926-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:34:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:34:56.322-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:34:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:35:26.645-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:35:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:35:56.942-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:35:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:36:27.243-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:36:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:36:57.524-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:36:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:37:27.802-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:37:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:37:58.099-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:37:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:38:28.491-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:38:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:38:58.849-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:38:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:39:11.343-0500 [conn3478] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T11:39:29.130-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:39:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:39:59.372-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:39:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:40:29.754-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:40:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:41:00.062-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:40:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:41:30.560-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:41:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:42:00.797-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:42:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:42:31.068-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:42:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:43:01.385-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:43:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:43:31.542-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:43:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:44:01.727-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:44:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:44:31.958-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:44:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:45:02.328-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:45:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:45:32.619-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:45:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:46:02.885-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:46:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:46:07.125-0500 [conn3479] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T11:46:33.252-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:46:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:47:03.544-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:47:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:47:33.714-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:47:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:48:04.111-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:48:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:48:34.303-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:48:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:49:04.704-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:49:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:49:35.092-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:49:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:49:35.103-0500 [UserCacheInvalidatorThread] User cache generation changed from 5882dbb64ee4ff0e5e4be74a to 588f6e984ee4ff0e5e4d14f3; invalidating user cache 2017-01-30T11:50:05.106-0500 [UserCacheInvalidatorThread] User cache generation changed from 588f6e984ee4ff0e5e4d14f3 to 588f6eae4ee4ff0e5e4d14f5; invalidating user cache 2017-01-30T11:50:05.394-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:50:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:50:35.601-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:50:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:51:05.847-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:51:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:51:07.192-0500 [conn3480] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T11:51:36.251-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:51:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:52:06.527-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:52:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:52:36.815-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:52:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:53:07.120-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:53:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:53:37.358-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:53:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:54:07.584-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:54:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:54:37.865-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:54:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:55:08.001-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:55:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:55:38.163-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:55:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:56:07.272-0500 [conn3481] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T11:56:08.399-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:56:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:56:38.692-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:56:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:57:08.978-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:57:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:57:39.250-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:57:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:58:09.470-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:58:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:58:39.740-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:58:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:59:10.098-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:59:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T11:59:40.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 11:59:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:00:10.712-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:00:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:00:40.993-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:00:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:01:07.193-0500 [conn3482] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T12:01:11.274-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:01:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:01:41.575-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:01:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:02:11.837-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:02:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:02:42.244-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:02:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:03:12.552-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:03:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:03:42.880-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:03:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:04:13.218-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:04:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:04:43.353-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:04:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:05:13.619-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:05:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:05:43.831-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:05:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:06:07.293-0500 [conn3483] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T12:06:14.114-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:06:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:06:44.250-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:06:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:07:14.506-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:07:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:07:44.843-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:07:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:08:15.229-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:08:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:08:45.441-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:08:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:09:15.760-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:09:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:09:46.065-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:09:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:10:16.313-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:10:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:10:46.447-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:10:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:11:07.115-0500 [conn3484] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T12:11:16.871-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:11:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:11:47.087-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:11:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:12:17.235-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:12:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:12:47.429-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:12:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:13:17.656-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:13:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:13:47.932-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:13:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:14:18.221-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:14:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:14:48.412-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:14:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:15:18.703-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:15:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:15:49.019-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:15:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:16:07.208-0500 [conn3485] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T12:16:19.214-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:16:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:16:49.475-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:16:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:17:19.795-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:17:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:17:49.992-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:17:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:18:20.267-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:18:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:18:50.549-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:18:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:19:20.844-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:19:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:19:51.121-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:19:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:20:21.433-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:20:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:20:51.726-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:20:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:21:07.349-0500 [conn3486] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T12:21:21.869-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:21:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:21:52.177-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:21:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:22:22.534-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:22:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:22:52.774-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:22:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:23:23.076-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:23:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:23:53.368-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:23:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:24:23.657-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:24:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:24:53.944-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:24:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:25:24.128-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:25:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:25:54.500-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:25:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:26:07.103-0500 [conn3487] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T12:26:24.780-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:26:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:26:55.056-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:26:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:27:25.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:27:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:27:55.642-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:27:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:28:25.928-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:28:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:28:56.194-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:28:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:29:26.471-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:29:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:29:56.760-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:29:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:30:27.091-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:30:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:30:57.330-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:30:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:31:07.256-0500 [conn3488] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T12:31:27.716-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:31:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:31:58.044-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:31:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:32:28.326-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:32:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:32:58.589-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:32:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:33:28.914-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:33:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:33:59.104-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:33:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:34:29.352-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:34:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:34:59.522-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:34:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:35:29.814-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:35:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:35:59.978-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:35:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:36:07.268-0500 [conn3489] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T12:36:30.274-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:36:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:37:00.560-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:37:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:37:30.834-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:37:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:38:01.025-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:38:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:38:31.249-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:38:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:39:01.435-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:39:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:39:31.710-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:39:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:40:01.954-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:40:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:40:32.117-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:40:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:41:02.512-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:41:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:41:07.276-0500 [conn3490] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T12:41:32.745-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:41:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:42:02.963-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:42:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:42:33.230-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:42:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:43:03.464-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:43:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:43:33.665-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:43:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:44:03.956-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:44:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:44:34.111-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:44:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:45:04.447-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:45:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:45:34.635-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:45:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:46:04.982-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:46:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:46:07.269-0500 [conn3491] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T12:46:35.241-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:46:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:47:05.516-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:47:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:47:35.796-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:47:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:48:06.087-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:48:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:48:36.364-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:48:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:49:06.632-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:49:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:49:36.781-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:49:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:50:07.006-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:50:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:50:37.258-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:50:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:51:07.114-0500 [conn3492] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T12:51:07.421-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:51:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:51:37.701-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:51:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:52:07.904-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:52:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:52:38.229-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:52:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:53:08.471-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:53:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:53:38.658-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:53:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:54:08.922-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:54:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:54:39.159-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:54:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:55:09.342-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:55:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:55:39.643-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:55:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:56:07.278-0500 [conn3493] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T12:56:09.947-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:56:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:56:40.241-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:56:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:57:10.584-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:57:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:57:40.848-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:57:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:58:11.059-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:58:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:58:41.234-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:58:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:59:11.545-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:59:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T12:59:41.893-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 12:59:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:00:12.052-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:00:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:00:42.260-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:00:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:01:12.539-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:01:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:01:42.821-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:01:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:02:13.104-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:02:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:02:43.488-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:02:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:03:13.777-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:03:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:03:25.238-0500 [conn3494] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T13:03:43.937-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:03:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:04:14.218-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:04:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:04:44.557-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:04:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:05:14.711-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:05:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:05:45.088-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:05:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:06:15.446-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:06:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:06:45.755-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:06:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:07:16.073-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:07:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:07:46.335-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:07:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:08:16.611-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:08:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:08:25.345-0500 [conn3495] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T13:08:46.929-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:08:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:09:17.197-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:09:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:09:47.483-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:09:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:10:17.815-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:10:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:10:48.100-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:10:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:11:18.412-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:11:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:11:48.807-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:11:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:12:19.104-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:12:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:12:49.396-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:12:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:13:19.668-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:13:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:13:25.291-0500 [conn3496] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T13:13:49.938-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:13:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:14:20.168-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:14:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:14:50.315-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:14:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:15:20.949-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:15:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:15:51.213-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:15:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:16:21.495-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:16:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:16:51.780-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:16:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:17:22.094-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:17:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:17:52.382-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:17:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:18:22.756-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:18:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:18:25.177-0500 [conn3497] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T13:18:53.061-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:18:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:19:23.569-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:19:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:19:53.839-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:19:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:20:24.120-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:20:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:20:54.381-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:20:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:21:24.660-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:21:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:21:54.949-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:21:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:22:25.210-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:22:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:22:55.498-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:22:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:23:25.382-0500 [conn3498] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T13:23:25.774-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:23:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:23:56.145-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:23:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:24:26.431-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:24:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:24:56.701-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:24:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:25:27.041-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:25:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:25:57.339-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:25:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:26:27.625-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:26:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:26:57.994-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:26:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:27:28.293-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:27:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:27:58.548-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:27:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:28:28.832-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:28:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:28:59.115-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:28:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:29:29.334-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:29:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:29:59.608-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:29:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:30:30.014-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:30:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:31:00.295-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:31:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:31:24.193-0500 [conn3499] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T13:31:30.718-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:31:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:32:01.018-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:32:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:32:31.376-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:32:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:33:01.874-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:33:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:33:32.155-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:33:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:34:02.472-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:34:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:34:32.755-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:34:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:35:03.050-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:35:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:35:33.359-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:35:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:36:03.634-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:36:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:36:24.135-0500 [conn3500] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T13:36:33.911-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:36:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:37:04.112-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:37:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:37:34.475-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:37:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:38:04.671-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:38:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:38:34.960-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:38:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:39:05.248-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:39:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:39:35.520-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:39:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:40:05.746-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:40:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:40:36.032-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:40:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:41:06.227-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:41:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:41:24.330-0500 [conn3501] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T13:41:36.515-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:41:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:42:06.786-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:42:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:42:37.081-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:42:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:43:07.340-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:43:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:43:37.643-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:43:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:44:07.963-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:44:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:44:38.302-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:44:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:45:08.497-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:45:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:45:38.703-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:45:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:46:09.104-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:46:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:46:24.292-0500 [conn3502] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T13:46:39.348-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:46:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:47:09.690-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:47:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:47:39.967-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:47:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:48:10.355-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:48:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:48:40.673-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:48:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:49:10.993-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:49:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:49:41.274-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:49:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:50:11.562-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:50:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:50:41.794-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:50:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:51:12.190-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:51:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:51:24.090-0500 [conn3503] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T13:51:42.482-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:51:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:52:12.848-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:52:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:52:43.134-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:52:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:53:13.424-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:53:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:53:43.719-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:53:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:54:13.997-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:54:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:54:44.443-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:54:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:55:14.722-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:55:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:55:45.159-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:55:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:56:15.292-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:56:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:56:24.333-0500 [conn3504] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T13:56:45.521-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:56:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:57:15.818-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:57:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:57:46.018-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:57:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:58:16.343-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:58:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:58:46.608-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:58:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:59:17.411-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:59:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T13:59:47.675-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 13:59:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:00:17.995-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:00:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:00:48.255-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:00:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:01:18.472-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:01:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:01:48.754-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:01:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:02:19.061-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:02:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:02:49.353-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:02:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:03:19.717-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:03:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:03:40.268-0500 [conn3505] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T14:03:50.016-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:03:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:04:20.410-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:04:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:04:50.728-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:04:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:05:20.985-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:05:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:05:51.291-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:05:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:06:21.589-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:06:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:06:51.895-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:06:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:07:22.202-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:07:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:07:52.349-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:07:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:08:22.518-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:08:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:08:40.224-0500 [conn3506] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T14:08:52.801-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:08:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:09:23.103-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:09:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:09:53.250-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:09:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:10:23.404-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:10:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:10:53.670-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:10:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:11:23.902-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:11:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:11:54.053-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:11:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:12:24.412-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:12:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:12:54.591-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:12:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:13:24.866-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:13:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:13:40.203-0500 [conn3507] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T14:13:55.018-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:13:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:14:25.289-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:14:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:14:55.466-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:14:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:15:25.756-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:15:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:15:55.916-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:15:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:16:26.232-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:16:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:16:56.761-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:16:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:17:26.976-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:17:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:17:57.336-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:17:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:18:27.637-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:18:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:18:57.950-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:18:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:19:21.240-0500 [conn3508] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T14:19:28.350-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:19:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:19:58.631-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:19:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:20:28.900-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:20:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:20:59.312-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:20:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:21:29.700-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:21:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:21:59.965-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:21:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:22:30.259-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:22:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:23:00.538-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:23:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:23:30.854-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:23:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:24:01.135-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:24:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:24:21.232-0500 [conn3509] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T14:24:31.423-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:24:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:25:01.615-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:25:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:25:31.873-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:25:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:26:02.152-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:26:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:26:32.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:26:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:27:02.807-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:27:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:27:33.072-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:27:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:28:03.363-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:28:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:28:10.278-0500 [conn3510] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T14:28:33.655-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:28:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:29:03.828-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:29:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:29:34.119-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:29:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:30:04.299-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:30:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:30:34.612-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:30:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:31:04.915-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:31:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:31:35.296-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:31:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:32:05.574-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:32:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:32:35.764-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:32:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:33:06.024-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:33:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:33:10.205-0500 [conn3511] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T14:33:36.304-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:33:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:34:06.571-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:34:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:34:36.744-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:34:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:35:07.129-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:35:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:35:37.426-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:35:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:36:07.568-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:36:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:36:37.915-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:36:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:37:08.212-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:37:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:37:38.492-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:37:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:38:08.662-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:38:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:38:10.084-0500 [conn3512] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T14:38:38.879-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:38:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:39:09.453-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:39:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:39:39.707-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:39:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:40:09.873-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:40:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:40:40.105-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:40:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:41:10.395-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:41:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:41:40.716-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:41:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:42:11.189-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:42:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:42:41.325-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:42:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:43:10.134-0500 [conn3513] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T14:43:11.464-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:43:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:43:41.697-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:43:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:44:11.895-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:44:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:44:42.228-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:44:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:45:12.502-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:45:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:45:42.634-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:45:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:46:12.856-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:46:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:46:43.094-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:46:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:47:13.366-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:47:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:47:43.682-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:47:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:48:10.261-0500 [conn3514] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T14:48:13.962-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:48:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:48:44.228-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:48:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:49:14.438-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:49:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:49:44.699-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:49:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:50:14.939-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:50:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:50:45.209-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:50:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:51:15.509-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:51:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:51:45.711-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:51:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:52:15.997-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:52:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:52:46.259-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:52:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:53:10.140-0500 [conn3515] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T14:53:16.556-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:53:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:53:46.705-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:53:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:54:16.982-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:54:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:54:47.179-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:54:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:55:17.421-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:55:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:55:47.721-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:55:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:56:18.107-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:56:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:56:48.372-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:56:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:57:18.669-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:57:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:57:48.959-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:57:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:58:10.339-0500 [conn3516] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T14:58:19.107-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:58:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:58:49.390-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:58:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:59:19.659-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:59:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T14:59:49.940-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 14:59:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:00:20.170-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:00:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:00:50.324-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:00:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:01:20.461-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:01:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:01:50.790-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:01:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:02:21.016-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:02:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:02:51.289-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:02:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:03:10.161-0500 [conn3517] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T15:03:21.481-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:03:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:03:51.842-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:03:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:04:22.129-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:04:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:04:52.395-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:04:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:05:22.752-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:05:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:05:53.042-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:05:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:06:23.332-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:06:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:06:53.598-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:06:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:07:23.874-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:07:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:07:54.307-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:07:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:08:10.341-0500 [conn3518] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T15:08:24.592-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:08:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:08:54.882-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:08:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:09:20.636-0500 [conn3519] authenticate db: historyDb { authenticate: 1, user: "its_rw", nonce: "xxx", key: "xxx" } 2017-01-30T15:09:25.058-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:09:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:09:55.324-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:09:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:10:03.529-0500 [conn3520] authenticate db: historyDb { authenticate: 1, user: "its_rw", nonce: "xxx", key: "xxx" } 2017-01-30T15:10:25.535-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:10:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:10:28.042-0500 [conn3521] authenticate db: historyDb { authenticate: 1, user: "its_rw", nonce: "xxx", key: "xxx" } 2017-01-30T15:10:28.445-0500 [conn3522] authenticate db: historyDb { authenticate: 1, user: "its_rw", nonce: "xxx", key: "xxx" } 2017-01-30T15:10:30.320-0500 [conn3523] authenticate db: historyDb { authenticate: 1, user: "its_rw", nonce: "xxx", key: "xxx" } 2017-01-30T15:10:30.322-0500 [conn3524] authenticate db: historyDb { authenticate: 1, user: "its_rw", nonce: "xxx", key: "xxx" } 2017-01-30T15:10:55.811-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:10:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:11:26.270-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:11:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:11:56.505-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:11:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:12:26.806-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:12:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:12:57.184-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:12:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:13:10.129-0500 [conn3525] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T15:13:27.459-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:13:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:13:57.747-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:13:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:14:28.059-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:14:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:14:58.441-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:14:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:15:28.732-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:15:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:15:59.019-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:15:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:16:29.288-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:16:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:16:59.573-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:16:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:17:30.018-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:17:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:18:00.293-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:18:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:18:10.267-0500 [conn3526] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T15:18:30.590-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:18:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:19:01.001-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:19:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:19:31.267-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:19:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:20:01.530-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:20:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:20:31.813-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:20:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:21:02.073-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:21:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:21:32.345-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:21:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:22:02.600-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:22:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:22:32.892-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:22:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:23:03.123-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:23:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:23:10.130-0500 [conn3527] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T15:23:33.265-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:23:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:24:03.388-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:24:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:24:33.712-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:24:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:25:03.923-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:25:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:25:34.150-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:25:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:26:04.315-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:26:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:26:34.584-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:26:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:27:04.860-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:27:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:27:35.121-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:27:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:28:05.315-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:28:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:28:10.274-0500 [conn3528] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T15:28:35.611-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:28:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:29:05.864-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:29:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:29:36.127-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:29:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:30:06.541-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:30:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:30:36.833-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:30:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:31:07.093-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:31:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:31:37.474-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:31:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:32:07.744-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:32:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:32:38.014-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:32:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:33:08.287-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:33:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:33:10.262-0500 [conn3529] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T15:33:38.438-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:33:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:34:08.725-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:34:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:34:39.011-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:34:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:35:09.312-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:35:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:35:39.581-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:35:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:36:09.949-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:36:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:36:40.136-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:36:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:37:10.291-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:37:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:37:40.483-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:37:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:38:10.129-0500 [conn3530] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T15:38:10.820-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:38:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:38:41.152-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:38:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:39:11.337-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:39:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:39:41.684-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:39:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:40:11.977-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:40:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:40:42.176-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:40:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:41:12.455-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:41:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:41:42.752-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:41:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:42:12.952-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:42:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:42:43.205-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:42:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:43:10.136-0500 [conn3531] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T15:43:13.539-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:43:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:43:43.671-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:43:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:44:13.820-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:44:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:44:44.095-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:44:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:45:14.323-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:45:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:45:44.561-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:45:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:46:14.863-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:46:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:46:45.138-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:46:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:47:15.392-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:47:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:47:45.668-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:47:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:48:10.361-0500 [conn3532] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T15:48:15.825-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:48:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:48:45.969-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:48:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:49:16.241-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:49:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:49:46.547-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:49:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:50:16.822-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:50:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:50:47.102-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:50:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:51:17.376-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:51:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:51:47.528-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:51:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:52:17.680-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:52:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:52:47.991-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:52:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:53:10.201-0500 [conn3533] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T15:53:18.229-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:53:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:53:48.614-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:53:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:54:18.888-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:54:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:54:49.170-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:54:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:55:19.473-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:55:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:55:49.771-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:55:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:56:20.053-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:56:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:56:50.345-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:56:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:57:20.653-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:57:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:57:50.920-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:57:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:58:10.225-0500 [conn3534] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T15:58:21.229-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:58:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:58:51.512-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:58:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:59:21.794-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:59:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T15:59:51.998-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 15:59:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:00:22.266-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:00:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:00:52.546-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:00:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:01:22.835-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:01:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:01:53.284-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:01:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:02:23.660-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:02:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:02:53.932-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:02:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:03:10.329-0500 [conn3535] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T16:03:24.125-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:03:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:03:54.405-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:03:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:04:24.540-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:04:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:04:54.837-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:04:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:05:25.167-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:05:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:05:55.464-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:05:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:06:25.800-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:06:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:06:56.111-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:06:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:07:26.399-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:07:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:07:56.691-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:07:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:08:10.112-0500 [conn3536] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T16:08:26.846-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:08:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:08:57.121-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:08:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:09:27.317-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:09:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:09:57.613-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:09:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:10:27.879-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:10:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:10:58.180-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:10:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:11:28.418-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:11:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:11:58.605-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:11:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:12:28.883-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:12:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:12:59.206-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:12:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:13:10.143-0500 [conn3537] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T16:13:29.567-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:13:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:13:59.938-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:13:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:14:30.222-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:14:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:15:00.628-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:15:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:15:30.894-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:15:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:16:01.076-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:16:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:16:31.350-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:16:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:17:01.542-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:17:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:17:31.739-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:17:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:18:02.024-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:18:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:18:10.303-0500 [conn3538] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T16:18:32.286-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:18:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:19:02.569-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:19:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:19:32.882-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:19:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:20:03.156-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:20:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:20:33.330-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:20:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:21:03.533-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:21:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:21:33.812-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:21:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:22:04.015-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:22:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:22:34.405-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:22:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:23:04.828-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:23:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:23:10.203-0500 [conn3539] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T16:23:35.127-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:23:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:24:05.414-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:24:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:24:35.712-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:24:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:25:06.076-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:25:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:25:36.339-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:25:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:26:06.616-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:26:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:26:36.896-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:26:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:27:07.258-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:27:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:27:37.410-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:27:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:28:07.613-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:28:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:28:10.184-0500 [conn3540] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T16:28:37.890-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:28:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:29:08.071-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:29:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:29:38.347-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:29:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:30:08.615-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:30:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:30:38.880-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:30:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:31:09.224-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:31:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:31:39.485-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:31:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:32:09.752-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:32:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:32:39.913-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:32:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:33:10.173-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:33:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:33:33.303-0500 [conn3541] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T16:33:40.513-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:33:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:34:10.806-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:34:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:34:41.079-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:34:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:35:11.408-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:35:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:35:41.657-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:35:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:36:11.950-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:36:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:36:42.237-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:36:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:37:12.548-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:37:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:37:42.832-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:37:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:38:13.023-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:38:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:38:33.197-0500 [conn3542] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T16:38:43.297-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:38:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:39:13.577-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:39:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:39:43.888-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:39:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:40:14.216-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:40:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:40:44.511-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:40:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:41:14.709-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:41:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:41:44.858-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:41:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:42:15.143-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:42:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:42:45.546-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:42:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:43:15.720-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:43:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:43:33.221-0500 [conn3543] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T16:43:45.984-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:43:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:44:16.260-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:44:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:44:46.546-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:44:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:45:16.834-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:45:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:45:47.120-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:45:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:46:17.459-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:46:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:46:47.669-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:46:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:47:17.947-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:47:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:47:48.210-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:47:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:48:18.493-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:48:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:48:33.151-0500 [conn3544] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T16:48:48.758-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:48:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:49:18.985-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:49:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:49:49.142-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:49:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:50:19.403-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:50:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:50:49.696-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:50:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:51:19.862-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:51:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:51:50.096-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:51:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:52:20.415-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:52:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:52:50.761-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:52:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:53:20.899-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:53:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:53:33.185-0500 [conn3545] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T16:53:51.141-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:53:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:54:21.414-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:54:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:54:51.815-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:54:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:55:22.092-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:55:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:55:52.408-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:55:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:56:22.825-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:56:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:56:53.048-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:56:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:57:23.317-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:57:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:57:53.578-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:57:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:58:23.898-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:58:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:58:33.296-0500 [conn3546] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T16:58:54.171-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:58:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:59:24.466-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:59:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T16:59:54.627-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 16:59:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:00:24.924-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:00:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:00:55.168-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:00:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:01:25.622-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:01:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:01:55.967-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:01:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:02:26.202-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:02:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:02:56.477-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:02:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:03:26.872-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:03:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:03:33.312-0500 [conn3547] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T17:03:57.144-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:03:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:04:27.557-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:04:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:04:57.840-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:04:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:05:28.041-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:05:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:05:58.316-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:05:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:06:28.786-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:06:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:06:58.957-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:06:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:07:29.242-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:07:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:07:59.520-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:07:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:08:29.738-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:08:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:08:33.223-0500 [conn3548] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T17:09:00.016-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:08:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:09:30.298-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:09:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:10:00.562-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:10:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:10:30.868-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:10:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:11:01.258-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:11:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:11:31.393-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:11:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:12:01.667-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:12:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:12:31.960-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:12:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:13:02.245-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:13:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:13:32.511-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:13:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:13:33.219-0500 [conn3549] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T17:14:02.696-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:14:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:14:33.003-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:14:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:15:03.154-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:15:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:15:33.298-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:15:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:16:03.652-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:16:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:16:33.892-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:16:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:17:04.175-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:17:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:17:34.510-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:17:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:18:04.814-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:18:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:18:33.201-0500 [conn3550] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T17:18:35.078-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:18:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:19:05.417-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:19:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:19:35.828-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:19:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:20:06.374-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:20:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:20:36.527-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:20:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:21:06.883-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:21:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:21:37.159-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:21:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:22:07.515-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:22:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:22:37.669-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:22:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:23:07.951-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:23:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:23:33.324-0500 [conn3551] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T17:23:38.199-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:23:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:24:08.834-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:24:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:24:38.986-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:24:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:25:09.254-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:25:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:25:39.396-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:25:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:26:09.664-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:26:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:26:39.867-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:26:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:27:10.095-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:27:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:27:40.281-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:27:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:28:10.585-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:28:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:28:33.142-0500 [conn3552] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T17:28:40.886-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:28:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:29:11.293-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:29:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:29:41.681-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:29:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:30:11.833-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:30:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:30:42.065-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:30:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:31:12.210-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:31:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:31:42.552-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:31:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:32:12.798-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:32:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:32:43.033-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:32:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:33:13.320-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:33:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:33:33.126-0500 [conn3553] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T17:33:43.496-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:33:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:34:13.783-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:34:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:34:44.063-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:34:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:35:14.242-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:35:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:35:44.477-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:35:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:36:14.761-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:36:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:36:45.052-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:36:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:37:15.340-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:37:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:37:45.683-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:37:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:38:15.944-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:38:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:38:33.090-0500 [conn3554] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T17:38:46.122-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:38:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:39:16.404-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:39:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:39:46.678-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:39:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:40:17.080-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:40:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:40:47.335-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:40:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:41:17.607-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:41:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:41:47.888-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:41:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:42:18.163-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:42:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:42:48.537-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:42:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:43:18.807-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:43:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:43:33.152-0500 [conn3555] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T17:43:49.063-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:43:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:44:19.363-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:44:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:44:49.631-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:44:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:45:20.017-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:45:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:45:50.293-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:45:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:46:20.620-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:46:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:46:50.910-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:46:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:47:21.185-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:47:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:47:51.499-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:47:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:48:21.770-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:48:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:48:33.273-0500 [conn3556] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T17:48:52.054-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:48:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:49:22.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:49:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:49:52.737-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:49:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:50:22.922-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:50:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:50:53.061-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:50:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:51:23.356-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:51:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:51:53.694-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:51:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:52:24.011-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:52:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:52:54.300-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:52:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:53:24.573-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:53:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:53:33.200-0500 [conn3557] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T17:53:54.844-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:53:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:54:25.297-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:54:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:54:55.638-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:54:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:55:25.919-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:55:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:55:56.186-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:55:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:56:26.570-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:56:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:56:56.830-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:56:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:57:27.124-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:57:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:57:57.392-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:57:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:58:27.677-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:58:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:58:33.073-0500 [conn3558] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T17:58:57.963-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:58:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:59:28.270-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:59:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T17:59:58.536-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 17:59:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:00:28.796-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:00:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:00:58.947-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:00:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:01:29.242-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:01:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:01:59.606-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:01:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:02:30.025-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:02:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:03:00.320-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:03:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:03:30.628-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:03:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:03:33.082-0500 [conn3559] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T18:04:00.908-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:04:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:04:31.130-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:04:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:05:01.422-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:05:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:05:31.674-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:05:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:06:01.836-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:06:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:06:32.159-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:06:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:07:02.456-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:07:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:07:32.730-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:07:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:08:03.147-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:08:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:08:33.105-0500 [conn3560] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T18:08:33.311-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:08:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:09:03.579-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:09:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:09:33.841-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:09:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:10:04.053-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:10:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:10:34.355-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:10:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:11:04.600-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:11:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:11:34.861-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:11:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:12:05.039-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:12:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:12:35.328-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:12:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:13:05.662-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:13:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:13:33.259-0500 [conn3561] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T18:13:35.970-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:13:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:14:06.154-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:14:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:14:36.480-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:14:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:15:06.798-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:15:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:15:37.073-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:15:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:16:07.206-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:16:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:16:37.609-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:16:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:17:07.906-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:17:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:17:38.181-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:17:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:18:08.482-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:18:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:18:33.318-0500 [conn3562] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T18:18:38.769-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:18:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:19:09.063-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:19:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:19:39.438-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:19:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:20:09.736-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:20:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:20:40.010-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:20:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:21:10.375-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:21:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:21:40.655-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:21:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:22:10.968-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:22:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:22:41.242-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:22:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:23:11.562-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:23:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:23:33.096-0500 [conn3563] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T18:23:41.762-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:23:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:24:11.898-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:24:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:24:42.281-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:24:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:25:12.465-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:25:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:25:42.748-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:25:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:26:13.143-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:26:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:26:43.464-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:26:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:27:13.819-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:27:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:27:44.000-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:27:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:28:14.345-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:28:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:28:33.085-0500 [conn3564] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T18:28:44.551-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:28:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:29:14.832-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:29:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:29:45.112-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:29:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:30:15.414-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:30:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:30:45.802-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:30:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:31:16.144-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:31:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:31:46.462-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:31:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:32:16.743-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:32:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:32:47.022-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:32:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:33:17.273-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:33:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:33:33.168-0500 [conn3565] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T18:33:47.698-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:33:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:34:17.926-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:34:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:34:48.061-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:34:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:35:18.340-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:35:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:35:48.809-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:35:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:36:19.084-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:36:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:36:49.290-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:36:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:37:19.478-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:37:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:37:49.808-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:37:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:38:20.220-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:38:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:38:33.234-0500 [conn3566] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T18:38:50.481-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:38:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:39:20.780-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:39:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:39:50.999-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:39:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:40:21.271-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:40:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:40:51.545-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:40:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:41:21.899-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:41:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:41:52.190-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:41:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:42:22.462-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:42:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:42:52.701-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:42:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:43:22.853-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:43:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:43:33.269-0500 [conn3567] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T18:43:53.032-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:43:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:44:23.335-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:44:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:44:53.610-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:44:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:45:23.910-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:45:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:45:54.171-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:45:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:46:24.341-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:46:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:46:54.601-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:46:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:47:24.829-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:47:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:47:55.186-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:47:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:48:25.338-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:48:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:48:33.238-0500 [conn3568] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T18:48:55.602-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:48:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:49:25.853-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:49:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:49:56.052-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:49:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:50:26.336-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:50:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:50:56.608-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:50:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:51:26.878-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:51:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:51:57.168-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:51:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:52:27.404-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:52:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:52:57.698-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:52:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:53:27.841-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:53:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:53:33.178-0500 [conn3569] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T18:53:58.140-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:53:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:54:28.349-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:54:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:54:58.641-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:54:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:55:28.916-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:55:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:55:59.211-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:55:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:56:29.482-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:56:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:56:59.770-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:56:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:57:29.979-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:57:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:58:00.286-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:57:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:58:30.587-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:58:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:58:33.148-0500 [conn3570] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T18:59:00.809-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:59:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T18:59:31.104-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 18:59:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:00:01.469-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:00:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:00:31.751-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:00:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:01:02.007-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:01:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:01:32.421-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:01:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:02:02.732-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:02:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:02:33.009-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:02:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:03:03.375-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:03:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:03:33.106-0500 [conn3571] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T19:03:33.560-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:03:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:04:03.815-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:04:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:04:34.151-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:04:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:05:04.451-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:05:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:05:34.731-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:05:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:06:05.069-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:06:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:06:35.344-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:06:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:07:05.548-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:07:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:07:35.842-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:07:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:08:06.142-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:08:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:08:33.218-0500 [conn3572] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T19:08:36.427-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:08:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:09:06.626-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:09:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:09:36.774-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:09:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:10:07.054-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:10:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:10:37.344-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:10:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:11:07.744-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:11:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:11:37.916-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:11:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:12:08.237-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:12:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:12:38.558-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:12:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:13:08.814-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:13:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:13:33.192-0500 [conn3573] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T19:13:39.089-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:13:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:14:09.406-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:14:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:14:39.656-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:14:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:15:09.957-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:15:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:15:40.261-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:15:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:16:10.500-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:16:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:16:40.841-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:16:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:17:11.273-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:17:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:17:41.670-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:17:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:18:11.981-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:18:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:18:33.303-0500 [conn3574] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T19:18:42.214-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:18:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:19:12.514-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:19:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:19:42.773-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:19:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:20:12.949-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:20:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:20:43.267-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:20:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:21:13.528-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:21:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:21:43.672-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:21:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:22:13.904-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:22:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:22:44.089-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:22:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:23:14.352-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:23:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:23:33.335-0500 [conn3575] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T19:23:44.548-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:23:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:24:14.816-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:24:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:24:44.977-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:24:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:25:15.219-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:25:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:25:45.495-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:25:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:26:15.652-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:26:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:26:45.928-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:26:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:27:16.185-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:27:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:27:46.617-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:27:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:28:16.845-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:28:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:28:33.214-0500 [conn3576] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T19:28:47.163-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:28:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:29:17.508-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:29:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:29:47.662-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:29:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:30:18.009-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:30:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:30:48.301-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:30:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:31:18.519-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:31:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:31:48.788-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:31:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:32:18.959-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:32:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:32:49.329-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:32:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:33:19.619-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:33:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:33:33.090-0500 [conn3577] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T19:33:49.931-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:33:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:34:20.279-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:34:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:34:50.433-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:34:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:35:20.716-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:35:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:35:50.898-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:35:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:36:21.155-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:36:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:36:51.315-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:36:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:37:21.564-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:37:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:37:51.809-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:37:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:38:22.052-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:38:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:38:33.286-0500 [conn3578] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T19:38:52.329-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:38:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:39:22.524-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:39:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:39:52.704-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:39:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:40:22.883-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:40:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:40:53.163-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:40:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:41:23.555-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:41:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:41:53.812-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:41:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:42:24.045-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:42:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:42:54.486-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:42:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:43:24.776-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:43:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:43:33.252-0500 [conn3579] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T19:43:55.070-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:43:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:44:25.344-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:44:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:44:55.511-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:44:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:45:25.800-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:45:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:45:56.153-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:45:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:46:26.374-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:46:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:46:56.556-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:46:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:47:26.845-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:47:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:47:57.119-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:47:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:48:27.418-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:48:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:48:33.204-0500 [conn3580] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T19:48:57.638-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:48:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:49:27.890-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:49:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:49:58.133-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:49:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:50:28.291-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:50:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:50:58.527-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:50:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:51:28.905-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:51:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:51:59.175-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:51:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:52:29.322-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:52:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:52:59.658-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:52:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:53:29.924-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:53:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:53:33.161-0500 [conn3581] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T19:54:00.256-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:53:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:54:30.535-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:54:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:55:00.818-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:55:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:55:31.071-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:55:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:56:01.487-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:56:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:56:31.826-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:56:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:57:02.101-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:57:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:57:32.413-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:57:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:58:02.749-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:58:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:58:33.014-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:58:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:58:33.096-0500 [conn3582] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T19:59:03.169-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:59:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T19:59:33.495-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 19:59:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:00:03.794-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:00:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:00:34.091-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:00:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:01:04.371-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:01:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:01:34.632-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:01:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:02:04.918-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:02:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:02:35.180-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:02:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:03:05.456-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:03:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:03:33.096-0500 [conn3583] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T20:03:35.627-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:03:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:04:05.793-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:04:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:04:35.944-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:04:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:05:06.106-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:05:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:05:36.376-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:05:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:06:06.658-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:06:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:06:36.816-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:06:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:07:07.099-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:07:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:07:37.335-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:07:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:08:07.682-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:08:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:08:33.096-0500 [conn3584] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T20:08:37.820-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:08:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:09:07.970-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:09:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:09:38.207-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:09:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:10:08.469-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:10:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:10:38.713-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:10:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:11:08.974-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:11:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:11:39.259-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:11:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:12:09.586-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:12:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:12:39.724-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:12:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:13:10.082-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:13:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:13:33.307-0500 [conn3585] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T20:13:40.439-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:13:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:14:10.725-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:14:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:14:41.019-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:14:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:15:11.223-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:15:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:15:41.564-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:15:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:16:11.822-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:16:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:16:42.113-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:16:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:17:12.451-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:17:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:17:42.705-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:17:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:18:12.978-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:18:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:18:33.420-0500 [conn3586] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T20:18:43.290-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:18:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:19:13.460-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:19:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:19:43.852-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:19:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:20:14.130-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:20:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:20:44.420-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:20:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:21:14.569-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:21:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:21:44.829-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:21:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:22:15.023-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:22:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:22:45.406-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:22:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:23:15.643-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:23:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:23:33.179-0500 [conn3587] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T20:23:46.079-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:23:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:24:16.387-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:24:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:24:46.658-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:24:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:25:16.981-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:25:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:25:47.268-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:25:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:26:17.563-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:26:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:26:47.830-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:26:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:27:17.996-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:27:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:27:48.140-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:27:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:28:18.430-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:28:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:28:33.428-0500 [conn3588] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T20:28:48.722-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:28:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:29:18.966-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:29:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:29:49.245-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:29:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:30:19.457-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:30:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:30:49.757-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:30:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:31:20.023-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:31:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:31:50.285-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:31:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:32:20.546-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:32:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:32:51.018-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:32:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:33:21.211-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:33:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:33:33.319-0500 [conn3589] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T20:33:51.525-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:33:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:34:21.684-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:34:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:34:51.949-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:34:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:35:22.290-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:35:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:35:52.591-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:35:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:36:22.744-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:36:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:36:53.007-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:36:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:37:23.364-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:37:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:37:53.638-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:37:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:38:23.826-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:38:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:38:33.167-0500 [conn3590] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T20:38:54.099-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:38:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:39:24.496-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:39:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:39:54.755-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:39:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:40:25.049-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:40:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:40:55.365-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:40:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:41:25.552-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:41:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:41:55.719-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:41:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:42:25.870-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:42:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:42:56.206-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:42:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:43:26.481-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:43:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:43:33.298-0500 [conn3591] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T20:43:56.790-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:43:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:44:27.114-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:44:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:44:57.396-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:44:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:45:27.662-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:45:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:45:57.949-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:45:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:46:28.191-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:46:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:46:58.505-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:46:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:47:28.918-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:47:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:47:59.252-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:47:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:48:29.532-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:48:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:48:33.319-0500 [conn3592] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T20:48:59.802-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:48:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:49:30.107-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:49:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:50:00.488-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:50:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:50:30.703-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:50:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:51:00.912-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:51:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:51:31.136-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:51:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:52:01.391-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:52:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:52:31.698-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:52:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:53:02.108-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:53:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:53:32.520-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:53:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:53:33.307-0500 [conn3593] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T20:54:02.794-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:54:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:54:32.938-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:54:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:55:03.168-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:55:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:55:33.470-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:55:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:56:03.939-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:56:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:56:34.242-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:56:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:57:04.512-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:57:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:57:34.815-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:57:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:58:05.044-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:58:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:58:33.356-0500 [conn3594] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T20:58:35.354-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:58:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:59:05.534-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:59:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T20:59:35.780-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 20:59:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:00:06.045-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:00:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:00:36.394-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:00:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:01:06.636-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:01:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:01:36.938-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:01:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:02:07.255-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:02:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:02:37.649-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:02:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:03:08.058-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:03:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:03:33.285-0500 [conn3595] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T21:03:38.323-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:03:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:04:08.619-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:04:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:04:38.756-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:04:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:05:08.893-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:05:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:05:39.179-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:05:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:06:09.335-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:06:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:06:39.474-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:06:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:07:09.698-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:07:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:07:39.907-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:07:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:08:10.089-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:08:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:08:33.416-0500 [conn3596] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T21:08:40.345-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:08:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:09:10.643-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:09:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:09:40.932-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:09:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:10:11.107-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:10:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:10:41.404-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:10:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:11:11.686-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:11:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:11:41.825-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:11:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:12:12.094-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:12:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:12:42.321-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:12:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:13:12.616-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:13:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:13:33.131-0500 [conn3597] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T21:13:42.881-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:13:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:14:13.164-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:14:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:14:43.335-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:14:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:15:13.549-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:15:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:15:43.825-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:15:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:16:14.167-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:16:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:16:44.511-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:16:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:17:14.865-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:17:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:17:45.167-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:17:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:18:15.447-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:18:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:18:33.335-0500 [conn3598] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T21:18:45.854-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:18:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:19:16.031-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:19:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:19:46.319-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:19:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:20:16.723-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:20:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:20:47.030-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:20:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:21:17.209-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:21:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:21:47.498-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:21:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:22:17.757-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:22:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:22:48.055-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:22:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:23:18.343-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:23:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:23:33.232-0500 [conn3599] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T21:23:48.645-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:23:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:24:18.910-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:24:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:24:49.215-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:24:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:25:19.496-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:25:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:25:49.770-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:25:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:26:20.035-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:26:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:26:50.294-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:26:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:27:20.580-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:27:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:27:50.882-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:27:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:28:21.273-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:28:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:28:33.225-0500 [conn3600] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T21:28:51.425-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:28:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:29:21.703-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:29:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:29:52.086-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:29:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:30:22.364-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:30:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:30:52.641-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:30:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:31:22.812-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:31:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:31:53.095-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:31:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:32:23.380-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:32:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:32:53.586-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:32:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:33:23.867-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:33:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:33:33.185-0500 [conn3601] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T21:33:54.147-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:33:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:34:24.413-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:34:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:34:54.647-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:34:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:35:24.838-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:35:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:35:55.047-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:35:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:36:25.454-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:36:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:36:55.791-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:36:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:37:26.061-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:37:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:37:56.247-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:37:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:38:26.427-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:38:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:38:33.233-0500 [conn3602] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T21:38:56.691-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:38:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:39:27.073-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:39:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:39:57.389-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:39:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:40:27.618-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:40:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:40:57.956-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:40:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:41:28.161-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:41:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:41:58.324-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:41:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:42:28.600-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:42:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:42:59.022-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:42:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:43:29.336-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:43:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:43:33.185-0500 [conn3603] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T21:43:59.605-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:43:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:44:29.900-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:44:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:45:00.088-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:44:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:45:30.358-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:45:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:46:00.613-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:46:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:46:30.880-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:46:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:47:01.153-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:47:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:47:31.466-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:47:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:48:01.776-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:48:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:48:32.060-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:48:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:48:33.336-0500 [conn3604] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T21:49:02.361-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:49:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:49:32.618-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:49:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:50:02.893-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:50:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:50:33.286-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:50:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:51:03.442-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:51:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:51:33.629-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:51:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:52:03.902-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:52:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:52:34.250-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:52:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:53:04.528-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:53:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:53:33.303-0500 [conn3605] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T21:53:34.813-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:53:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:54:05.199-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:54:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:54:35.495-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:54:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:55:05.778-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:55:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:55:36.056-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:55:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:56:06.319-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:56:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:56:36.588-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:56:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:57:06.847-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:57:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:57:37.089-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:57:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:58:07.395-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:58:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:58:33.302-0500 [conn3606] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T21:58:37.718-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:58:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:59:08.103-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:59:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T21:59:38.246-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 21:59:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:00:08.406-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:00:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:00:38.665-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:00:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:01:08.979-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:01:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:01:39.141-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:01:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:02:09.403-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:02:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:02:39.733-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:02:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:03:10.012-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:03:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:03:33.143-0500 [conn3607] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T22:03:40.336-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:03:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:04:10.605-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:04:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:04:40.937-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:04:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:05:11.267-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:05:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:05:41.467-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:05:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:06:11.721-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:06:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:06:42.035-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:06:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:07:12.458-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:07:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:07:42.728-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:07:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:08:13.043-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:08:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:08:33.346-0500 [conn3608] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T22:08:43.327-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:08:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:09:13.608-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:09:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:09:43.899-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:09:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:10:14.169-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:10:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:10:44.361-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:10:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:11:14.657-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:11:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:11:44.858-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:11:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:12:15.278-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:12:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:12:45.476-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:12:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:13:15.792-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:13:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:13:33.179-0500 [conn3609] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T22:13:46.038-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:13:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:14:16.499-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:14:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:14:46.690-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:14:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:15:16.989-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:15:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:15:47.253-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:15:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:16:17.535-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:16:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:16:47.715-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:16:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:17:17.987-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:17:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:17:48.305-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:17:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:18:18.611-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:18:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:18:33.288-0500 [conn3610] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T22:18:48.814-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:18:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:19:19.078-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:19:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:19:49.324-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:19:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:20:19.501-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:20:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:20:49.801-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:20:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:21:20.151-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:21:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:21:50.543-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:21:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:22:20.823-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:22:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:22:51.085-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:22:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:23:21.273-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:23:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:23:33.118-0500 [conn3611] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T22:23:51.563-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:23:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:24:21.904-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:24:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:24:52.213-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:24:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:25:22.480-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:25:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:25:52.774-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:25:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:26:15.229-0500 [conn3612] authenticate db: historyDb { authenticate: 1, user: "its_rw", nonce: "xxx", key: "xxx" } 2017-01-30T22:26:23.060-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:26:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:26:53.344-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:26:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:27:23.618-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:27:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:27:53.906-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:27:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:28:24.065-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:28:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:28:33.140-0500 [conn3613] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T22:28:54.349-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:28:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:29:24.625-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:29:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:29:54.936-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:29:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:30:25.219-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:30:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:30:55.515-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:30:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:31:25.883-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:31:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:31:56.184-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:31:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:32:26.405-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:32:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:32:56.684-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:32:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:33:26.922-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:33:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:33:33.156-0500 [conn3614] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T22:33:57.120-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:33:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:34:27.428-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:34:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:34:57.703-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:34:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:35:27.960-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:35:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:35:58.107-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:35:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:36:28.448-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:36:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:36:58.742-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:36:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:37:28.952-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:37:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:37:59.105-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:37:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:38:29.238-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:38:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:38:33.244-0500 [conn3615] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T22:38:59.426-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:38:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:39:29.698-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:39:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:39:59.971-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:39:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:40:30.199-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:40:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:41:00.507-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:41:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:41:30.708-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:41:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:42:01.021-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:42:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:42:31.229-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:42:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:43:01.488-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:43:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:43:31.752-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:43:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:43:33.111-0500 [conn3616] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T22:44:02.046-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:44:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:44:32.217-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:44:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:45:02.413-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:45:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:45:32.575-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:45:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:46:02.740-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:46:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:46:32.943-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:46:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:47:03.182-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:47:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:47:33.346-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:47:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:48:03.539-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:48:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:48:33.385-0500 [conn3617] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T22:48:33.815-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:48:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:49:04.135-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:49:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:49:34.338-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:49:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:50:04.625-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:50:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:50:34.926-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:50:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:51:05.271-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:51:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:51:35.536-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:51:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:52:05.675-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:52:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:52:35.959-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:52:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:53:06.288-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:53:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:53:33.241-0500 [conn3618] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T22:53:36.687-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:53:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:54:06.922-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:54:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:54:37.212-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:54:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:55:07.630-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:55:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:55:38.062-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:55:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:56:08.304-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:56:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:56:38.582-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:56:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:57:09.002-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:57:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:57:39.158-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:57:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:58:09.335-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:58:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:58:33.289-0500 [conn3619] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T22:58:39.525-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:58:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:59:09.841-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:59:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T22:59:40.140-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 22:59:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:00:10.484-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:00:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:00:40.836-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:00:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:01:11.137-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:01:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:01:41.424-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:01:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:02:11.632-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:02:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:02:41.814-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:02:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:03:12.137-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:03:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:03:33.126-0500 [conn3620] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T23:03:42.345-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:03:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:04:12.608-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:04:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:04:42.900-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:04:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:05:13.167-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:05:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:05:43.514-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:05:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:06:13.661-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:06:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:06:43.866-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:06:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:07:14.187-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:07:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:07:44.490-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:07:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:08:14.812-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:08:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:08:33.270-0500 [conn3621] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T23:08:45.091-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:08:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:09:15.400-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:09:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:09:45.697-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:09:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:10:16.058-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:10:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:10:46.402-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:10:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:11:16.692-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:11:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:11:46.974-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:11:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:12:17.215-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:12:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:12:47.357-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:12:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:13:17.692-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:13:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:13:33.221-0500 [conn3622] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T23:13:48.003-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:13:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:14:18.184-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:14:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:14:48.464-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:14:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:15:18.645-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:15:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:15:49.050-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:15:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:16:19.342-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:16:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:16:49.537-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:16:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:17:19.692-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:17:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:17:50.062-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:17:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:18:20.427-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:18:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:18:33.315-0500 [conn3623] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T23:18:50.745-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:18:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:19:21.005-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:19:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:19:51.369-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:19:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:20:21.597-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:20:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:20:51.731-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:20:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:21:21.984-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:21:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:21:52.276-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:21:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:22:22.573-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:22:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:22:52.716-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:22:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:23:22.997-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:23:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:23:33.182-0500 [conn3624] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T23:23:53.160-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:23:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:24:23.399-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:24:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:24:53.765-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:24:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:25:23.935-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:25:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:25:54.277-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:25:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:26:24.553-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:26:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:26:54.856-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:26:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:27:25.143-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:27:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:27:55.430-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:27:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:28:25.743-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:28:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:28:33.270-0500 [conn3625] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T23:28:56.022-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:28:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:29:26.264-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:29:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:29:56.498-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:29:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:30:26.802-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:30:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:30:57.100-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:30:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:31:27.267-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:31:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:31:57.546-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:31:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:32:27.797-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:32:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:32:58.058-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:32:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:33:28.317-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:33:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:33:33.194-0500 [conn3626] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T23:33:58.678-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:33:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:34:29.054-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:34:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:34:59.328-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:34:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:35:29.471-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:35:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:35:59.647-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:35:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:36:29.847-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:36:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:37:00.097-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:36:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:37:30.434-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:37:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:38:00.821-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:38:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:38:31.015-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:38:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:38:33.139-0500 [conn3627] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T23:39:01.372-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:39:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:39:31.521-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:39:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:40:01.810-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:40:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:40:32.052-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:40:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:41:02.324-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:41:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:41:32.501-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:41:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:42:02.772-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:42:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:42:33.006-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:42:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:43:03.278-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:43:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:43:33.323-0500 [conn3628] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T23:43:33.558-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:43:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:44:03.992-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:44:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:44:34.219-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:44:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:45:04.493-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:45:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:45:34.775-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:45:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:46:05.061-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:46:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:46:35.345-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:46:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:47:05.630-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:47:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:47:35.858-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:47:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:48:06.213-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:48:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:48:33.145-0500 [conn3629] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T23:48:36.419-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:48:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:49:06.578-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:49:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:49:36.878-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:49:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:50:07.147-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:50:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:50:37.433-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:50:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:51:07.708-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:51:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:51:38.112-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:51:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:52:08.370-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:52:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:52:38.633-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:52:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:53:08.938-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:53:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:53:33.206-0500 [conn3630] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T23:53:39.231-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:53:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:54:09.531-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:54:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:54:39.913-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:54:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:55:10.215-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:55:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:55:40.504-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:55:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:56:10.821-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:56:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:56:41.147-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:56:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:57:11.356-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:57:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:57:41.663-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:57:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:58:11.864-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:58:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:58:33.128-0500 [conn3631] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-30T23:58:42.265-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:58:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:59:13.116-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:59:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-30T23:59:43.294-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Mon Jan 30 23:59:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:00:13.622-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:00:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:00:43.857-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:00:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:01:14.139-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:01:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:01:44.341-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:01:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:02:14.736-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:02:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:02:44.875-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:02:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:03:15.023-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:03:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:03:33.311-0500 [conn3632] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T00:03:45.285-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:03:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:04:15.592-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:04:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:04:45.954-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:04:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:05:16.236-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:05:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:05:46.529-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:05:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:06:16.826-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:06:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:06:47.122-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:06:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:07:17.400-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:07:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:07:47.674-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:07:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:08:17.941-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:08:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:08:33.197-0500 [conn3633] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T00:08:48.265-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:08:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:09:18.508-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:09:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:09:48.822-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:09:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:10:19.106-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:10:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:10:49.445-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:10:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:11:19.602-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:11:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:11:49.881-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:11:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:12:20.138-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:12:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:12:50.333-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:12:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:13:20.675-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:13:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:13:33.312-0500 [conn3634] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T00:13:50.888-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:13:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:14:21.067-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:14:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:14:51.347-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:14:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:15:21.643-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:15:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:15:51.911-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:15:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:16:22.201-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:16:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:16:52.479-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:16:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:17:22.775-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:17:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:17:53.091-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:17:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:18:23.353-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:18:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:18:33.289-0500 [conn3635] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T00:18:53.517-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:18:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:19:23.792-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:19:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:19:54.008-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:19:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:20:24.287-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:20:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:20:54.483-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:20:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:21:24.630-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:21:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:21:54.893-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:21:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:22:25.080-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:22:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:22:55.346-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:22:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:23:25.653-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:23:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:23:33.284-0500 [conn3636] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T00:23:56.031-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:23:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:24:26.270-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:24:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:24:56.566-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:24:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:25:26.859-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:25:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:25:57.097-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:25:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:26:27.401-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:26:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:26:57.585-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:26:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:27:27.987-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:27:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:27:58.118-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:27:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:28:28.510-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:28:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:28:33.126-0500 [conn3637] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T00:28:58.663-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:28:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:29:28.933-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:29:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:29:59.147-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:29:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:30:29.428-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:30:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:30:59.728-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:30:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:31:29.984-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:31:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:32:00.263-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:31:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:32:30.403-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:32:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:33:00.696-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:33:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:33:30.986-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:33:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:33:33.245-0500 [conn3638] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T00:34:01.343-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:34:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:34:31.697-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:34:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:35:01.969-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:35:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:35:32.272-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:35:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:36:02.551-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:36:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:36:32.864-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:36:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:37:03.098-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:37:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:37:33.358-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:37:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:38:03.642-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:38:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:38:33.130-0500 [conn3639] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T00:38:33.917-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:38:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:39:04.171-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:39:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:39:34.472-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:39:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:40:04.752-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:40:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:40:35.033-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:40:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:41:05.375-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:41:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:41:35.657-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:41:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:42:05.894-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:42:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:42:36.275-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:42:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:43:06.615-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:43:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:43:33.284-0500 [conn3640] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T00:43:36.924-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:43:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:44:07.080-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:44:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:44:37.431-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:44:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:45:07.748-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:45:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:45:38.040-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:45:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:46:08.313-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:46:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:46:38.517-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:46:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:47:08.793-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:47:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:47:39.145-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:47:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:48:09.326-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:48:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:48:33.289-0500 [conn3641] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T00:48:39.663-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:48:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:49:09.951-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:49:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:49:40.156-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:49:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:50:10.428-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:50:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:50:40.716-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:50:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:51:11.038-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:51:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:51:41.323-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:51:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:52:11.602-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:52:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:52:41.904-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:52:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:53:12.284-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:53:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:53:33.206-0500 [conn3642] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T00:53:42.418-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:53:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:54:12.652-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:54:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:54:42.832-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:54:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:55:13.179-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:55:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:55:43.488-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:55:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:56:13.751-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:56:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:56:43.903-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:56:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:57:14.257-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:57:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:57:44.534-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:57:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:58:14.820-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:58:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:58:33.269-0500 [conn3643] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T00:58:45.078-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:58:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:59:15.451-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:59:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T00:59:45.600-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 00:59:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:00:15.992-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:00:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:00:46.356-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:00:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:01:16.535-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:01:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:01:46.808-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:01:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:02:17.008-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:02:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:02:47.261-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:02:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:03:17.497-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:03:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:03:33.194-0500 [conn3644] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T01:03:47.790-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:03:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:04:18.110-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:04:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:04:48.407-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:04:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:05:18.686-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:05:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:05:48.993-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:05:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:06:19.142-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:06:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:06:49.469-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:06:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:07:19.678-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:07:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:07:49.952-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:07:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:08:20.138-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:08:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:08:33.253-0500 [conn3645] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T01:08:50.414-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:08:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:09:20.674-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:09:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:09:50.973-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:09:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:10:21.247-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:10:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:10:51.393-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:10:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:11:21.757-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:11:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:11:51.966-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:11:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:12:22.250-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:12:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:12:52.482-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:12:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:13:22.672-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:13:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:13:33.179-0500 [conn3646] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T01:13:52.945-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:13:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:14:23.291-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:14:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:14:53.556-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:14:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:15:23.785-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:15:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:15:54.056-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:15:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:16:24.414-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:16:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:16:54.615-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:16:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:17:24.902-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:17:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:17:55.186-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:17:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:18:25.447-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:18:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:18:33.241-0500 [conn3647] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T01:18:55.630-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:18:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:19:25.914-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:19:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:19:56.172-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:19:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:20:26.497-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:20:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:20:56.696-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:20:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:21:26.960-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:21:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:21:57.164-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:21:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:22:27.410-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:22:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:22:57.724-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:22:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:23:28.005-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:23:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:23:33.092-0500 [conn3648] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T01:23:58.307-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:23:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:24:28.592-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:24:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:24:58.882-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:24:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:25:29.162-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:25:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:25:59.319-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:25:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:26:29.493-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:26:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:26:59.678-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:26:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:27:29.941-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:27:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:28:00.244-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:27:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:28:30.586-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:28:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:28:33.317-0500 [conn3649] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T01:29:00.892-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:29:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:29:31.163-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:29:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:30:01.460-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:30:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:30:31.832-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:30:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:31:02.149-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:31:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:31:32.494-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:31:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:32:02.775-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:32:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:32:33.038-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:32:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:33:03.345-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:33:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:33:33.256-0500 [conn3650] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T01:33:33.552-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:33:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:34:03.911-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:34:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:34:34.055-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:34:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:35:04.335-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:35:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:35:34.727-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:35:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:36:05.001-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:36:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:36:35.225-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:36:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:37:05.482-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:37:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:37:35.762-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:37:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:38:06.028-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:38:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:38:33.234-0500 [conn3651] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T01:38:36.275-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:38:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:39:06.431-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:39:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:39:36.638-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:39:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:40:06.831-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:40:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:40:37.224-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:40:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:41:07.499-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:41:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:41:37.763-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:41:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:42:08.046-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:42:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:42:38.303-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:42:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:43:08.439-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:43:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:43:33.186-0500 [conn3652] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T01:43:38.723-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:43:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:44:08.909-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:44:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:44:39.181-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:44:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:45:09.420-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:45:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:45:39.691-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:45:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:46:10.048-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:46:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:46:40.399-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:46:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:47:10.667-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:47:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:47:40.801-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:47:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:48:11.096-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:48:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:48:33.446-0500 [conn3653] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T01:48:41.385-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:48:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:49:11.674-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:49:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:49:41.986-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:49:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:50:12.254-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:50:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:50:42.617-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:50:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:51:12.900-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:51:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:51:43.065-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:51:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:52:13.338-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:52:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:52:43.624-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:52:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:53:13.910-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:53:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:53:33.209-0500 [conn3654] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T01:53:44.310-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:53:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:54:14.715-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:54:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:54:45.001-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:54:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:55:15.270-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:55:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:55:45.554-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:55:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:56:15.826-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:56:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:56:46.101-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:56:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:57:16.405-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:57:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:57:46.565-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:57:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:58:16.764-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:58:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:58:33.148-0500 [conn3655] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T01:58:47.019-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:58:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:59:17.296-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:59:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T01:59:47.501-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 01:59:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:00:17.755-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:00:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:00:48.027-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:00:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:01:18.331-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:01:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:01:48.597-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:01:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:02:18.772-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:02:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:02:49.056-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:02:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:03:19.305-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:03:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:03:33.306-0500 [conn3656] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T02:03:49.578-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:03:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:04:19.837-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:04:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:04:50.169-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:04:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:05:20.640-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:05:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:05:50.972-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:05:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:06:21.326-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:06:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:06:51.591-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:06:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:07:21.873-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:07:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:07:52.030-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:07:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:08:22.185-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:08:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:08:33.234-0500 [conn3657] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T02:08:52.441-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:08:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:09:22.740-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:09:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:09:52.889-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:09:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:10:23.041-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:10:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:10:53.324-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:10:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:11:23.607-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:11:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:11:53.914-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:11:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:12:24.311-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:12:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:12:54.505-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:12:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:13:24.801-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:13:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:13:33.130-0500 [conn3658] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T02:13:55.056-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:13:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:14:25.417-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:14:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:14:55.692-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:14:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:15:26.017-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:15:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:15:56.302-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:15:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:16:26.567-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:16:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:16:56.864-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:16:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:17:27.174-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:17:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:17:57.355-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:17:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:18:27.629-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:18:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:18:33.173-0500 [conn3659] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T02:18:57.906-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:18:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:19:28.307-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:19:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:19:58.572-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:19:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:20:28.880-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:20:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:20:59.251-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:20:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:21:29.614-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:21:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:21:59.899-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:21:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:22:30.050-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:22:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:23:00.330-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:23:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:23:30.515-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:23:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:23:33.170-0500 [conn3660] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T02:24:00.705-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:24:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:24:30.855-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:24:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:25:01.022-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:25:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:25:31.297-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:25:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:26:01.587-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:26:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:26:31.861-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:26:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:27:02.218-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:27:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:27:32.501-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:27:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:28:02.788-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:28:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:28:33.154-0500 [conn3661] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T02:28:33.220-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:28:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:29:03.538-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:29:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:29:33.675-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:29:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:30:03.944-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:30:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:30:34.278-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:30:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:31:04.483-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:31:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:31:34.886-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:31:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:32:05.172-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:32:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:32:35.461-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:32:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:33:05.753-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:33:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:33:33.322-0500 [conn3662] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T02:33:36.122-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:33:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:34:06.383-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:34:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:34:36.658-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:34:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:35:06.817-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:35:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:35:37.066-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:35:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:36:07.355-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:36:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:36:37.636-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:36:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:37:07.782-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:37:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:37:38.077-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:37:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:38:08.377-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:38:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:38:33.250-0500 [conn3663] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T02:38:38.639-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:38:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:39:08.915-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:39:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:39:39.195-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:39:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:40:09.635-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:40:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:40:39.784-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:40:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:41:10.162-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:41:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:41:40.447-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:41:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:42:10.755-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:42:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:42:40.997-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:42:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:43:11.326-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:43:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:43:33.099-0500 [conn3664] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T02:43:41.594-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:43:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:44:11.762-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:44:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:44:42.149-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:44:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:45:12.435-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:45:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:45:42.579-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:45:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:46:12.768-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:46:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:46:43.024-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:46:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:47:13.301-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:47:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:47:43.492-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:47:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:48:13.810-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:48:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:48:33.140-0500 [conn3665] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T02:48:44.087-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:48:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:49:14.453-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:49:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:49:44.815-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:49:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:50:15.085-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:50:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:50:45.375-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:50:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:51:15.655-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:51:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:51:46.116-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:51:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:52:16.425-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:52:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:52:46.758-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:52:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:53:16.992-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:53:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:53:33.133-0500 [conn3666] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T02:53:47.273-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:53:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:54:17.541-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:54:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:54:47.729-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:54:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:55:18.091-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:55:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:55:48.391-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:55:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:56:18.721-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:56:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:56:49.017-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:56:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:57:19.253-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:57:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:57:49.513-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:57:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:58:19.808-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:58:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:58:33.210-0500 [conn3667] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T02:58:50.102-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:58:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:59:20.374-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:59:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T02:59:50.742-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 02:59:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:00:20.966-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:00:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:00:51.362-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:00:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:01:21.631-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:01:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:01:51.787-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:01:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:02:22.060-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:02:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:02:52.265-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:02:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:03:22.576-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:03:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:03:33.227-0500 [conn3668] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T03:03:52.849-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:03:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:04:23.128-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:04:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:04:53.301-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:04:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:05:23.556-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:05:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:05:53.736-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:05:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:06:24.073-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:06:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:06:54.344-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:06:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:07:24.530-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:07:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:07:54.808-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:07:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:08:24.986-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:08:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:08:33.125-0500 [conn3669] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T03:08:55.232-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:08:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:09:25.475-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:09:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:09:55.760-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:09:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:10:26.012-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:10:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:10:56.284-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:10:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:11:26.567-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:11:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:11:56.784-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:11:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:12:27.057-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:12:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:12:57.338-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:12:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:13:27.663-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:13:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:13:33.202-0500 [conn3670] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T03:13:57.850-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:13:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:14:27.986-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:14:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:14:58.285-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:14:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:15:28.558-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:15:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:15:58.898-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:15:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:16:29.161-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:16:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:16:59.472-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:16:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:17:29.738-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:17:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:18:00.026-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:17:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:18:30.295-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:18:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:18:33.203-0500 [conn3671] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T03:19:00.443-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:19:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:19:30.733-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:19:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:20:00.994-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:20:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:20:31.271-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:20:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:21:01.617-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:21:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:21:31.901-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:21:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:22:02.267-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:22:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:22:32.467-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:22:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:23:02.630-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:23:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:23:32.907-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:23:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:23:33.282-0500 [conn3672] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T03:24:03.176-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:24:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:24:33.469-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:24:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:25:03.760-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:25:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:25:34.024-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:25:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:26:04.347-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:26:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:26:34.590-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:26:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:27:04.891-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:27:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:27:35.037-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:27:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:28:05.294-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:28:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:28:33.195-0500 [conn3673] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T03:28:35.530-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:28:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:29:05.783-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:29:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:29:36.063-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:29:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:30:06.407-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:30:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:30:36.689-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:30:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:31:06.931-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:31:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:31:37.129-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:31:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:32:07.423-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:32:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:32:37.726-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:32:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:33:08.097-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:33:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:33:33.306-0500 [conn3674] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T03:33:38.419-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:33:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:34:08.573-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:34:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:34:38.776-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:34:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:35:09.229-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:35:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:35:39.521-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:35:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:36:09.787-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:36:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:36:40.114-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:36:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:37:10.372-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:37:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:37:40.650-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:37:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:38:10.956-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:38:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:38:33.132-0500 [conn3675] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T03:38:41.352-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:38:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:39:11.587-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:39:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:39:41.938-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:39:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:40:12.208-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:40:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:40:42.649-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:40:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:41:12.954-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:41:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:41:43.282-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:41:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:42:13.552-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:42:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:42:43.868-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:42:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:43:14.134-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:43:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:43:33.212-0500 [conn3676] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T03:43:44.281-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:43:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:44:14.576-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:44:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:44:44.828-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:44:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:45:15.169-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:45:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:45:45.556-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:45:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:46:15.926-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:46:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:46:46.204-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:46:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:47:16.505-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:47:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:47:46.843-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:47:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:48:17.152-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:48:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:48:33.085-0500 [conn3677] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T03:48:47.534-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:48:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:49:17.828-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:49:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:49:48.148-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:49:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:50:18.419-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:50:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:50:48.694-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:50:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:51:19.066-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:51:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:51:49.345-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:51:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:52:19.647-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:52:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:52:49.992-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:52:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:53:20.335-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:53:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:53:33.230-0500 [conn3678] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T03:53:50.607-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:53:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:54:20.824-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:54:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:54:51.234-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:54:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:55:21.497-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:55:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:55:51.788-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:55:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:56:22.094-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:56:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:56:52.451-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:56:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:57:22.729-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:57:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:57:53.127-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:57:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:58:23.406-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:58:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:58:33.204-0500 [conn3679] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T03:58:53.705-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:58:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:59:24.002-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:59:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T03:59:54.225-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 03:59:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:00:24.498-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:00:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:00:54.746-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:00:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:01:24.948-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:01:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:01:55.128-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:01:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:02:25.427-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:02:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:02:55.693-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:02:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:03:25.960-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:03:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:03:33.238-0500 [conn3680] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T04:03:56.296-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:03:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:04:26.618-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:04:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:04:56.895-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:04:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:05:27.125-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:05:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:05:57.483-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:05:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:06:27.787-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:06:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:06:58.078-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:06:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:07:28.398-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:07:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:07:58.704-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:07:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:08:28.978-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:08:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:08:33.200-0500 [conn3681] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T04:08:59.261-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:08:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:09:29.489-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:09:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:09:59.635-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:09:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:10:29.914-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:10:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:11:00.193-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:10:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:11:30.444-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:11:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:12:00.710-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:12:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:12:31.026-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:12:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:13:01.308-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:13:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:13:31.610-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:13:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:13:33.217-0500 [conn3682] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T04:14:01.750-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:14:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:14:32.044-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:14:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:15:02.388-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:15:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:15:32.674-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:15:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:16:02.966-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:16:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:16:33.283-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:16:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:17:03.599-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:17:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:17:33.973-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:17:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:18:04.194-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:18:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:18:33.323-0500 [conn3683] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T04:18:34.547-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:18:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:19:04.823-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:19:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:19:35.122-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:19:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:20:05.282-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:20:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:20:35.576-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:20:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:21:05.876-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:21:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:21:36.137-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:21:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:22:06.308-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:22:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:22:36.525-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:22:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:23:06.817-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:23:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:23:33.095-0500 [conn3684] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T04:23:37.068-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:23:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:24:07.355-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:24:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:24:37.584-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:24:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:25:07.864-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:25:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:25:38.344-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:25:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:26:08.626-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:26:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:26:38.895-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:26:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:27:09.200-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:27:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:27:39.526-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:27:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:28:09.802-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:28:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:28:33.323-0500 [conn3685] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T04:28:40.186-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:28:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:29:10.584-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:29:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:29:41.033-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:29:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:30:11.361-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:30:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:30:21.008-0500 [conn3686] authenticate db: historyDb { authenticate: 1, user: "its_rw", nonce: "xxx", key: "xxx" } 2017-01-31T04:30:24.985-0500 [conn3687] authenticate db: historyDb { authenticate: 1, user: "its_rw", nonce: "xxx", key: "xxx" } 2017-01-31T04:30:24.988-0500 [conn3688] authenticate db: historyDb { authenticate: 1, user: "its_rw", nonce: "xxx", key: "xxx" } 2017-01-31T04:30:41.619-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:30:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:31:11.888-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:31:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:31:42.144-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:31:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:32:12.415-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:32:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:32:42.737-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:32:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:33:12.941-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:33:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:33:33.328-0500 [conn3689] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T04:33:43.244-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:33:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:34:13.536-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:34:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:34:43.745-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:34:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:35:13.950-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:35:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:35:44.147-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:35:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:36:14.475-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:36:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:36:44.746-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:36:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:37:15.022-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:37:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:37:45.164-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:37:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:38:15.315-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:38:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:38:33.335-0500 [conn3690] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T04:38:45.683-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:38:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:39:15.865-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:39:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:39:46.153-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:39:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:40:16.347-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:40:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:40:46.657-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:40:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:41:16.921-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:41:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:41:47.261-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:41:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:42:17.586-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:42:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:42:47.864-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:42:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:43:18.147-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:43:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:43:33.154-0500 [conn3691] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T04:43:48.439-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:43:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:44:18.676-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:44:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:44:48.942-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:44:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:45:19.220-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:45:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:45:49.509-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:45:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:46:19.789-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:46:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:46:50.102-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:46:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:47:20.357-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:47:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:47:50.698-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:47:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:48:20.975-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:48:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:48:33.188-0500 [conn3692] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T04:48:51.242-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:48:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:49:21.476-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:49:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:49:51.766-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:49:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:50:22.096-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:50:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:50:52.381-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:50:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:51:22.631-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:51:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:51:52.795-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:51:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:52:23.152-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:52:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:52:53.424-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:52:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:53:23.690-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:53:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:53:33.294-0500 [conn3693] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T04:53:54.044-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:53:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:54:24.306-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:54:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:54:54.527-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:54:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:55:24.803-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:55:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:55:55.062-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:55:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:56:25.337-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:56:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:56:55.687-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:56:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:57:25.907-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:57:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:57:56.260-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:57:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:58:26.524-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:58:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:58:33.264-0500 [conn3694] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T04:58:56.724-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:58:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:59:27.004-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:59:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T04:59:57.380-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 04:59:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:00:27.676-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:00:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:00:57.891-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:00:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:01:28.024-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:01:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:01:58.235-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:01:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:02:28.459-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:02:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:02:58.731-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:02:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:03:29.127-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:03:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:03:33.331-0500 [conn3695] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T05:03:59.340-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:03:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:04:29.640-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:04:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:04:59.867-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:04:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:05:30.175-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:05:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:06:00.445-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:06:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:06:30.676-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:06:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:07:01.025-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:07:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:07:31.276-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:07:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:08:01.473-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:08:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:08:31.744-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:08:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:08:33.263-0500 [conn3696] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T05:09:01.969-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:09:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:09:32.231-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:09:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:10:02.520-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:10:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:10:32.929-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:10:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:11:03.220-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:11:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:11:33.477-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:11:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:12:03.762-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:12:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:12:34.059-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:12:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:13:04.256-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:13:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:13:33.117-0500 [conn3697] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T05:13:34.585-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:13:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:14:04.881-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:14:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:14:35.088-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:14:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:15:05.433-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:15:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:15:35.593-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:15:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:16:05.884-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:16:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:16:36.241-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:16:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:17:06.524-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:17:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:17:36.783-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:17:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:18:07.066-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:18:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:18:33.192-0500 [conn3698] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T05:18:37.445-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:18:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:19:07.714-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:19:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:19:37.850-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:19:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:20:08.199-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:20:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:20:38.393-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:20:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:21:08.671-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:21:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:21:38.943-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:21:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:22:09.228-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:22:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:22:39.369-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:22:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:23:09.519-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:23:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:23:33.215-0500 [conn3699] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T05:23:39.717-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:23:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:24:10.007-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:24:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:24:40.349-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:24:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:25:10.608-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:25:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:25:40.911-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:25:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:26:11.284-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:26:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:26:41.609-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:26:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:27:11.981-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:27:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:27:42.176-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:27:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:28:12.449-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:28:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:28:33.293-0500 [conn3700] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T05:28:42.737-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:28:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:29:13.009-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:29:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:29:43.373-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:29:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:30:13.618-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:30:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:30:43.909-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:30:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:31:14.167-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:31:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:31:44.309-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:31:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:32:14.534-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:32:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:32:44.828-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:32:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:33:15.110-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:33:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:33:33.089-0500 [conn3701] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T05:33:45.397-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:33:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:34:15.687-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:34:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:34:46.057-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:34:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:35:16.257-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:35:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:35:46.537-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:35:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:36:16.800-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:36:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:36:47.091-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:36:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:37:17.273-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:37:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:37:47.616-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:37:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:38:17.780-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:38:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:38:33.205-0500 [conn3702] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T05:38:47.931-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:38:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:39:18.205-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:39:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:39:48.502-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:39:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:40:18.798-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:40:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:40:49.049-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:40:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:41:19.200-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:41:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:41:49.494-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:41:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:42:19.759-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:42:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:42:50.016-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:42:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:43:20.297-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:43:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:43:33.225-0500 [conn3703] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T05:43:50.562-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:43:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:44:20.845-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:44:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:44:51.123-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:44:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:45:21.294-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:45:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:45:51.572-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:45:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:46:21.870-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:46:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:46:52.214-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:46:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:47:22.390-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:47:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:47:52.593-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:47:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:48:22.851-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:48:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:48:33.099-0500 [conn3704] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T05:48:53.084-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:48:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:49:23.393-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:49:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:49:53.761-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:49:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:50:24.051-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:50:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:50:54.382-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:50:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:51:24.710-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:51:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:51:54.992-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:51:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:52:25.251-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:52:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:52:55.474-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:52:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:53:25.743-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:53:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:53:33.224-0500 [conn3705] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T05:53:56.021-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:53:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:54:26.368-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:54:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:54:56.556-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:54:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:55:26.872-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:55:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:55:57.077-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:55:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:56:27.405-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:56:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:56:57.593-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:56:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:57:27.853-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:57:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:57:58.125-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:57:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:58:28.431-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:58:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:58:33.255-0500 [conn3706] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T05:58:58.667-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:58:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:59:28.882-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:59:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T05:59:59.156-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 05:59:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:00:29.489-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:00:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:00:59.905-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:00:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:01:30.070-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:01:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:02:00.332-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:02:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:02:30.654-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:02:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:03:00.928-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:03:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:03:31.130-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:03:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:03:33.286-0500 [conn3707] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T06:04:01.378-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:04:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:04:31.658-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:04:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:05:01.940-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:05:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:05:32.223-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:05:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:06:02.509-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:06:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:06:32.679-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:06:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:07:02.819-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:07:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:07:32.961-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:07:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:08:03.200-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:08:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:08:33.335-0500 [conn3708] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T06:08:33.483-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:08:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:09:03.757-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:09:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:09:34.052-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:09:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:10:04.318-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:10:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:10:34.591-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:10:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:11:04.731-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:11:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:11:35.044-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:11:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:12:05.304-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:12:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:12:35.597-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:12:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:13:05.861-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:13:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:13:33.337-0500 [conn3709] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T06:13:36.133-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:13:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:14:06.418-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:14:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:14:36.603-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:14:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:15:07.011-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:15:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:15:37.173-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:15:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:16:07.417-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:16:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:16:37.678-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:16:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:17:08.039-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:17:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:17:38.335-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:17:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:18:08.609-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:18:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:18:33.306-0500 [conn3710] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T06:18:38.928-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:18:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:19:09.210-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:19:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:19:39.477-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:19:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:20:09.861-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:20:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:20:40.130-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:20:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:21:10.359-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:21:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:21:40.523-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:21:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:22:10.855-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:22:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:22:41.007-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:22:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:23:11.184-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:23:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:23:33.203-0500 [conn3711] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T06:23:41.453-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:23:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:24:11.744-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:24:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:24:42.122-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:24:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:25:12.408-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:25:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:25:42.686-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:25:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:26:12.993-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:26:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:26:43.241-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:26:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:27:13.487-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:27:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:27:43.685-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:27:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:28:14.051-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:28:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:28:33.223-0500 [conn3712] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T06:28:44.336-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:28:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:29:14.606-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:29:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:29:44.867-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:29:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:30:15.046-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:30:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:30:45.238-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:30:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:31:15.383-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:31:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:31:45.603-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:31:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:32:15.803-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:32:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:32:46.100-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:32:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:33:16.339-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:33:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:33:33.216-0500 [conn3713] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T06:33:46.597-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:33:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:34:16.977-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:34:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:34:47.241-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:34:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:35:17.479-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:35:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:35:47.700-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:35:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:36:17.961-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:36:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:36:48.236-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:36:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:37:18.502-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:37:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:37:48.654-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:37:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:38:18.899-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:38:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:38:33.118-0500 [conn3714] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T06:38:49.154-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:38:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:39:19.436-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:39:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:39:49.691-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:39:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:40:20.048-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:40:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:40:50.290-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:40:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:41:20.609-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:41:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:41:51.040-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:41:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:42:21.321-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:42:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:42:51.615-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:42:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:43:21.879-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:43:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:43:33.120-0500 [conn3715] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T06:43:52.178-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:43:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:44:22.563-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:44:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:44:52.774-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:44:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:45:23.175-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:45:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:45:53.534-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:45:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:46:23.696-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:46:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:46:53.871-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:46:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:47:24.139-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:47:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:47:54.453-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:47:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:48:24.671-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:48:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:48:33.276-0500 [conn3716] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T06:48:54.958-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:48:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:49:25.228-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:49:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:49:55.564-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:49:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:50:25.823-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:50:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:50:55.976-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:50:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:51:26.259-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:51:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:51:56.537-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:51:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:52:26.838-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:52:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:52:57.248-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:52:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:53:27.518-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:53:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:53:33.179-0500 [conn3717] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T06:53:57.831-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:53:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:54:28.107-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:54:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:54:58.448-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:54:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:55:28.783-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:55:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:55:59.105-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:55:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:56:29.370-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:56:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:56:59.656-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:56:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:57:29.870-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:57:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:58:00.131-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:57:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:58:30.394-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:58:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:58:33.265-0500 [conn3718] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T06:59:00.673-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:59:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T06:59:31.043-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 06:59:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:00:01.225-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:00:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:00:31.608-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:00:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:01:01.888-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:01:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:01:32.171-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:01:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:02:02.449-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:02:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:02:32.740-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:02:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:03:03.118-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:03:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:03:33.142-0500 [conn3719] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T07:03:33.363-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:03:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:04:03.650-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:04:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:04:33.916-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:04:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:05:04.193-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:05:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:05:34.373-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:05:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:06:04.719-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:06:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:06:35.012-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:06:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:07:05.163-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:07:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:07:35.542-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:07:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:08:05.729-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:08:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:08:33.127-0500 [conn3720] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T07:08:36.028-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:08:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:09:06.175-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:09:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:09:36.470-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:09:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:10:06.671-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:10:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:10:36.935-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:10:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:11:07.098-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:11:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:11:37.431-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:11:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:12:07.812-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:12:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:12:38.132-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:12:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:13:08.389-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:13:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:13:33.193-0500 [conn3721] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T07:13:38.664-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:13:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:14:08.936-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:14:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:14:39.236-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:14:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:15:09.417-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:15:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:15:39.704-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:15:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:16:10.112-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:16:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:16:40.381-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:16:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:17:10.670-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:17:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:17:40.977-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:17:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:18:11.346-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:18:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:18:33.155-0500 [conn3722] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T07:18:41.813-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:18:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:19:12.128-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:19:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:19:42.417-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:19:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:20:12.626-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:20:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:20:42.883-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:20:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:21:13.196-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:21:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:21:43.537-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:21:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:22:13.676-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:22:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:22:44.011-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:22:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:23:14.375-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:23:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:23:34.094-0500 [conn3723] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T07:23:44.767-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:23:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:24:15.091-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:24:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:24:33.108-0500 [conn3724] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T07:24:45.369-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:24:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:25:15.539-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:25:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:25:45.799-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:25:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:26:16.083-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:26:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:26:46.516-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:26:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:27:16.799-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:27:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:27:47.100-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:27:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:28:17.459-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:28:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:28:47.753-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:28:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:29:18.036-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:29:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:29:33.286-0500 [conn3725] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T07:29:48.373-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:29:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:30:18.654-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:30:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:30:49.031-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:30:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:31:19.223-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:31:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:31:49.501-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:31:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:32:19.790-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:32:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:32:50.061-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:32:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:33:20.221-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:33:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:33:50.504-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:33:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:34:20.704-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:34:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:34:33.117-0500 [conn3726] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T07:34:50.983-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:34:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:35:21.253-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:35:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:35:51.540-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:35:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:36:21.816-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:36:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:36:52.098-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:36:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:37:22.420-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:37:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:37:52.680-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:37:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:38:23.148-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:38:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:38:53.524-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:38:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:39:23.808-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:39:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:39:33.360-0500 [conn3727] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T07:39:54.136-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:39:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:40:24.424-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:40:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:40:54.590-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:40:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:41:24.859-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:41:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:41:55.005-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:41:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:42:25.282-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:42:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:42:55.516-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:42:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:43:25.800-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:43:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:43:56.085-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:43:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:44:26.393-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:44:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:44:33.179-0500 [conn3728] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T07:44:56.660-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:44:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:45:27.019-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:45:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:45:57.207-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:45:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:46:27.474-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:46:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:46:40.460-0500 [conn3612] ChunkManager: time to load chunks for historyDb.History: 109ms sequenceNumber: 10 version: 3285|25||55c0dbaf5b591f0b0cfcee5f based on: 3285|23||55c0dbaf5b591f0b0cfcee5f 2017-01-31T07:46:57.690-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:46:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:47:27.961-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:47:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:47:58.254-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:47:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:48:28.522-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:48:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:48:58.776-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:48:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:49:28.944-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:49:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:49:33.305-0500 [conn3729] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T07:49:59.182-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:49:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:50:29.457-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:50:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:50:59.733-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:50:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:51:29.874-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:51:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:52:00.018-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:51:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:52:30.321-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:52:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:53:00.583-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:53:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:53:30.874-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:53:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:54:01.178-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:54:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:54:31.461-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:54:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:54:34.131-0500 [conn3730] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T07:55:01.759-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:55:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:55:32.034-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:55:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:56:02.366-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:56:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:56:32.639-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:56:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:57:02.838-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:57:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:57:33.136-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:57:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:58:03.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:58:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:58:33.757-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:58:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:59:04.081-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:59:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T07:59:33.310-0500 [conn3731] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T07:59:34.382-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 07:59:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:00:04.681-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:00:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:00:34.871-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:00:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:01:05.141-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:01:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:01:35.468-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:01:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:02:05.864-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:02:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:02:36.124-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:02:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:03:06.409-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:03:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:03:36.708-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:03:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:04:07.060-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:04:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:04:33.223-0500 [conn3732] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T08:04:37.379-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:04:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:05:07.581-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:05:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:05:37.869-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:05:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:06:08.163-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:06:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:06:38.451-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:06:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:07:08.721-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:07:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:07:39.115-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:07:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:08:09.439-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:08:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:08:39.578-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:08:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:09:09.835-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:09:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:09:33.209-0500 [conn3733] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T08:09:39.984-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:09:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:10:10.184-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:10:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:10:40.508-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:10:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:11:10.659-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:11:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:11:40.949-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:11:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:12:11.222-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:12:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:12:41.542-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:12:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:13:11.841-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:13:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:13:42.053-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:13:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:14:12.374-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:14:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:14:33.295-0500 [conn3734] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T08:14:42.576-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:14:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:15:13.042-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:15:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:15:43.311-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:15:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:16:13.652-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:16:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:16:43.818-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:16:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:17:14.105-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:17:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:17:44.399-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:17:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:18:14.717-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:18:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:18:44.975-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:18:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:19:15.164-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:19:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:19:33.230-0500 [conn3735] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T08:19:45.427-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:19:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:20:15.763-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:20:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:20:45.949-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:20:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:21:16.322-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:21:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:21:46.530-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:21:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:22:16.719-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:22:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:22:47.010-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:22:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:23:17.199-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:23:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:23:47.468-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:23:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:24:17.752-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:24:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:24:33.105-0500 [conn3736] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T08:24:48.055-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:24:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:25:18.197-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:25:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:25:48.405-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:25:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:26:18.714-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:26:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:26:49.001-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:26:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:27:19.225-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:27:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:27:49.411-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:27:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:28:19.624-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:28:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:28:49.913-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:28:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:29:20.125-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:29:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:29:33.088-0500 [conn3737] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T08:29:50.387-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:29:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:30:20.532-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:30:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:30:50.815-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:30:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:31:21.090-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:31:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:31:51.386-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:31:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:32:21.565-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:32:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:32:51.833-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:32:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:33:22.108-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:33:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:33:52.356-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:33:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:34:22.665-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:34:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:34:33.339-0500 [conn3738] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T08:34:52.943-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:34:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:35:23.112-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:35:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:35:53.476-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:35:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:36:23.784-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:36:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:36:54.105-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:36:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:37:24.398-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:37:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:37:54.539-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:37:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:38:24.806-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:38:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:38:55.081-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:38:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:39:25.240-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:39:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:39:33.438-0500 [conn3739] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T08:39:55.467-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:39:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:40:25.615-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:40:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:40:55.804-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:40:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:41:26.210-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:41:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:41:56.446-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:41:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:42:26.719-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:42:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:42:57.015-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:42:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:43:27.302-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:43:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:43:57.576-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:43:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:44:27.724-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:44:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:44:33.127-0500 [conn3740] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T08:44:58.015-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:44:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:45:28.288-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:45:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:45:58.582-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:45:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:46:28.880-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:46:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:46:59.080-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:46:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:47:29.352-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:47:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:47:59.636-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:47:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:48:29.924-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:48:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:49:00.186-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:48:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:49:30.368-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:49:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:49:33.305-0500 [conn3741] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T08:50:00.594-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:50:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:50:30.871-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:50:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:51:01.150-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:51:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:51:31.422-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:51:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:52:01.700-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:52:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:52:32.044-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:52:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:53:02.246-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:53:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:53:32.412-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:53:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:54:02.574-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:54:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:54:32.837-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:54:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:54:33.116-0500 [conn3742] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T08:55:03.119-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:55:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:55:33.419-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:55:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:56:03.707-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:56:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:56:33.939-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:56:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:57:04.137-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:57:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:57:34.391-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:57:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:58:04.613-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:58:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:58:34.879-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:58:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:59:05.168-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:59:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T08:59:33.201-0500 [conn3743] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T08:59:35.404-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 08:59:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:00:05.649-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:00:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:00:35.922-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:00:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:01:06.123-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:01:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:01:36.391-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:01:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:02:06.612-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:02:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:02:36.919-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:02:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:03:07.196-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:03:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:03:37.495-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:03:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:04:07.855-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:04:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:04:33.260-0500 [conn3744] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T09:04:38.163-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:04:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:05:08.458-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:05:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:05:38.743-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:05:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:06:09.134-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:06:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:06:39.529-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:06:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:07:09.919-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:07:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:07:40.199-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:07:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:08:10.550-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:08:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:08:40.830-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:08:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:09:11.104-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:09:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:09:33.104-0500 [conn3745] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T09:09:41.376-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:09:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:10:11.727-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:10:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:10:42.016-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:10:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:11:12.327-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:11:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:11:42.633-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:11:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:12:12.917-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:12:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:12:43.223-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:12:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:13:13.557-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:13:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:13:43.821-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:13:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:14:14.160-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:14:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:14:33.229-0500 [conn3746] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T09:14:44.313-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:14:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:15:14.638-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:15:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:15:45.065-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:15:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:16:15.424-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:16:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:16:45.698-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:16:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:17:15.838-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:17:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:17:46.057-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:17:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:18:16.348-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:18:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:18:46.596-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:18:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:19:16.942-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:19:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:19:33.184-0500 [conn3747] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T09:19:47.277-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:19:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:20:17.600-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:20:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:20:47.912-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:20:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:21:18.145-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:21:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:21:48.479-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:21:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:22:18.782-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:22:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:22:49.059-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:22:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:23:19.351-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:23:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:23:49.634-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:23:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:24:19.905-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:24:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:24:33.318-0500 [conn3748] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T09:24:50.159-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:24:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:25:20.472-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:25:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:25:50.861-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:25:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:26:21.149-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:26:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:26:51.476-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:26:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:27:21.704-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:27:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:27:52.069-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:27:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:28:22.368-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:28:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:28:52.666-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:28:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:29:23.036-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:29:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:29:33.162-0500 [conn3749] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T09:29:53.283-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:29:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:30:23.635-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:30:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:30:54.038-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:30:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:31:24.257-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:31:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:31:54.560-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:31:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:32:24.821-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:32:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:32:55.113-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:32:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:33:25.379-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:33:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:33:55.645-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:33:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:34:25.949-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:34:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:34:33.234-0500 [conn3750] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T09:34:56.217-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:34:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:35:26.547-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:35:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:35:56.847-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:35:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:36:27.057-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:36:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:36:57.348-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:36:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:37:27.678-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:37:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:37:57.906-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:37:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:38:28.130-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:38:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:38:58.515-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:38:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:39:28.807-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:39:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:39:33.271-0500 [conn3751] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T09:39:59.112-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:39:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:40:29.375-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:40:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:40:59.703-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:40:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:41:30.113-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:41:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:42:00.415-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:42:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:42:30.692-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:42:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:43:01.052-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:43:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:43:31.309-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:43:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:44:01.598-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:44:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:44:31.937-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:44:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:44:33.098-0500 [conn3752] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T09:45:02.108-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:45:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:45:32.362-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:45:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:46:02.618-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:46:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:46:32.937-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:46:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:47:03.179-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:47:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:47:33.463-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:47:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:48:03.712-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:48:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:48:34.147-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:48:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:49:04.339-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:49:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:49:33.148-0500 [conn3753] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T09:49:34.632-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:49:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:50:04.831-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:50:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:50:35.044-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:50:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:51:05.309-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:51:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:51:35.619-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:51:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:52:05.908-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:52:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:52:36.178-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:52:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:53:06.549-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:53:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:53:36.698-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:53:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:54:07.098-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:54:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:54:33.204-0500 [conn3754] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T09:54:37.627-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:54:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:55:07.791-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:55:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:55:37.953-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:55:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:56:08.093-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:56:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:56:38.375-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:56:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:57:08.614-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:57:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:57:39.004-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:57:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:58:09.331-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:58:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:58:39.528-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:58:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:59:09.857-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:59:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T09:59:33.146-0500 [conn3755] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T09:59:40.294-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 09:59:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:00:10.587-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:00:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:00:40.890-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:00:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:01:11.149-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:01:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:01:41.374-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:01:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:02:11.578-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:02:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:02:42.014-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:02:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:03:12.310-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:03:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:03:42.555-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:03:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:04:12.795-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:04:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:04:33.100-0500 [conn3756] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T10:04:43.039-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:04:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:05:13.355-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:05:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:05:43.651-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:05:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:06:13.877-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:06:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:06:44.213-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:06:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:07:14.478-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:07:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:07:44.823-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:07:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:08:15.161-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:08:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:08:45.492-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:08:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:09:15.874-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:09:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:09:33.220-0500 [conn3757] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T10:09:46.141-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:09:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:10:16.429-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:10:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:10:46.709-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:10:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:11:16.943-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:11:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:11:47.235-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:11:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:12:17.474-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:12:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:12:47.906-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:12:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:13:18.150-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:13:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:13:48.468-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:13:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:14:18.827-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:14:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:14:33.181-0500 [conn3758] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T10:14:49.173-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:14:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:15:19.497-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:15:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:15:49.803-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:15:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:16:20.113-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:16:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:16:50.462-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:16:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:17:20.750-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:17:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:17:50.913-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:17:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:18:21.063-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:18:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:18:51.375-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:18:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:19:21.620-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:19:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:19:33.114-0500 [conn3759] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T10:19:51.901-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:19:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:20:22.172-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:20:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:20:52.456-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:20:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:21:22.848-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:21:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:21:53.182-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:21:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:22:23.466-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:22:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:22:53.733-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:22:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:23:24.009-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:23:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:23:54.401-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:23:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:24:24.686-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:24:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:24:33.352-0500 [conn3760] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T10:24:55.009-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:24:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:25:25.357-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:25:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:25:55.578-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:25:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:26:25.862-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:26:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:26:56.197-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:26:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:27:26.431-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:27:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:27:56.712-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:27:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:28:27.108-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:28:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:28:57.466-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:28:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:29:27.732-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:29:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:29:33.326-0500 [conn3761] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T10:29:58.028-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:29:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:30:28.296-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:30:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:30:58.580-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:30:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:31:28.730-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:31:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:31:58.994-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:31:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:32:29.159-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:32:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:32:59.443-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:32:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:33:29.605-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:33:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:33:59.892-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:33:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:34:30.255-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:34:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:34:33.238-0500 [conn3762] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T10:35:00.494-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:35:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:35:30.733-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:35:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:36:00.866-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:36:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:36:31.171-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:36:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:37:01.548-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:37:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:37:31.921-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:37:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:38:02.174-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:38:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:38:32.461-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:38:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:39:02.692-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:39:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:39:32.911-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:39:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:39:33.162-0500 [conn3763] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T10:40:03.233-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:40:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:40:33.514-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:40:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:41:03.877-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:41:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:41:34.157-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:41:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:42:04.494-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:42:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:42:34.762-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:42:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:43:05.004-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:43:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:43:35.293-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:43:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:44:05.688-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:44:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:44:33.287-0500 [conn3764] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T10:44:35.929-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:44:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:45:06.125-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:45:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:45:36.429-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:45:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:46:06.694-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:46:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:46:36.872-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:46:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:47:07.187-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:47:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:47:37.426-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:47:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:48:07.690-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:48:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:48:37.954-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:48:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:49:08.223-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:49:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:49:33.317-0500 [conn3765] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T10:49:38.580-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:49:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:50:08.949-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:50:08 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:50:39.344-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:50:38 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:51:09.557-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:51:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:51:39.907-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:51:39 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:52:10.119-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:52:09 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:52:40.531-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:52:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:53:10.878-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:53:10 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:53:41.194-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:53:40 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:54:11.404-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:54:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:54:33.265-0500 [conn3766] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T10:54:41.633-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:54:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:55:11.946-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:55:11 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:55:42.183-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:55:41 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:56:12.476-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:56:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:56:42.811-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:56:42 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:57:13.079-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:57:12 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:57:43.342-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:57:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:58:13.589-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:58:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:58:43.827-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:58:43 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:59:14.736-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:59:13 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T10:59:33.095-0500 [conn3767] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T10:59:44.922-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 10:59:44 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:00:15.157-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:00:14 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:00:45.453-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:00:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:01:15.646-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:01:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:01:45.913-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:01:45 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:02:16.235-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:02:15 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:02:46.554-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:02:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:03:16.748-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:03:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:03:46.898-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:03:46 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:04:17.177-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:04:16 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:04:33.231-0500 [conn3768] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T11:04:47.391-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:04:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:05:17.694-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:05:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:05:47.848-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:05:47 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:06:18.108-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:06:17 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:06:48.475-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:06:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:07:18.949-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:07:18 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:07:49.230-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:07:48 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:08:19.501-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:08:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:08:49.798-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:08:49 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:09:20.188-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:09:19 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:09:33.317-0500 [conn3769] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T11:09:50.458-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:09:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:10:20.746-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:10:20 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:10:51.035-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:10:50 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:11:21.330-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:11:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:11:51.642-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:11:51 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:12:22.005-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:12:21 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:12:52.272-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:12:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:13:22.480-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:13:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:13:52.868-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:13:52 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:14:23.154-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:14:22 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:14:33.156-0500 [conn3770] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T11:14:53.482-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:14:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:15:23.752-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:15:23 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:15:54.078-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:15:53 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:16:24.323-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:16:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:16:54.783-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:16:54 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:17:25.155-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:17:24 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:17:55.437-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:17:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:18:25.670-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:18:25 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:18:56.076-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:18:55 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:19:26.288-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:19:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:19:33.388-0500 [conn3771] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T11:19:56.580-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:19:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:20:26.824-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:20:26 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:20:57.034-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:20:56 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:21:27.294-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:21:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:21:57.565-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:21:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:22:27.833-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:22:27 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:22:58.114-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:22:57 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:23:28.382-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:23:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:23:58.586-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:23:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:24:28.770-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:24:28 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:24:33.281-0500 [conn3772] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T11:24:59.081-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:24:58 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:25:29.369-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:25:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:25:59.572-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:25:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:26:29.849-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:26:29 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:27:00.067-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:26:59 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:27:30.413-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:27:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:28:00.653-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:28:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:28:30.896-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:28:30 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:29:01.194-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:29:00 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:29:31.413-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:29:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:29:33.335-0500 [conn3773] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T11:30:01.689-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:30:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:30:31.971-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:30:31 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:31:02.280-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:31:01 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:31:32.596-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:31:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:32:02.761-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:32:02 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:32:33.065-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:32:32 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:33:03.338-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:33:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:33:33.687-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:33:33 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:34:04.005-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:34:03 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:34:33.199-0500 [conn3774] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T11:34:34.241-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:34:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:35:04.621-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:35:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:35:34.892-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:35:34 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:36:05.266-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:36:04 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:36:35.616-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:36:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:37:05.983-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:37:05 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:37:36.292-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:37:35 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:38:06.646-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:38:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:38:36.907-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:38:36 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:39:07.157-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:39:06 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:39:33.269-0500 [conn3775] authenticate db: admin { authenticate: 1, user: "dbs_scout2", nonce: "xxx", key: "xxx" } 2017-01-31T11:39:37.372-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:39:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:40:07.656-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:40:07 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:40:37.982-0500 [LockPinger] cluster tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 pinged successfully at Tue Jan 31 11:40:37 2017 by distributed lock pinger 'tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307/its-a51.white.xxx.com:4356:1484950181:1804289383', sleeping for 30000ms 2017-01-31T11:41:12.519-0500 I CONTROL ***** SERVER RESTARTED ***** 2017-01-31T11:41:12.560-0500 I SHARDING [mongosMain] MongoS version 3.0.14 starting: pid=12107 port=4356 64-bit host=its-a51.white.xxx.com (--help for usage) 2017-01-31T11:41:12.560-0500 I CONTROL [mongosMain] db version v3.0.14 2017-01-31T11:41:12.560-0500 I CONTROL [mongosMain] git version: 08352afcca24bfc145240a0fac9d28b978ab77f3 2017-01-31T11:41:12.560-0500 I CONTROL [mongosMain] build info: Linux ip-10-154-238-164 2.6.32-220.el6.x86_64 #1 SMP Wed Nov 9 08:03:13 EST 2011 x86_64 BOOST_LIB_VERSION=1_49 2017-01-31T11:41:12.560-0500 I CONTROL [mongosMain] allocator: tcmalloc 2017-01-31T11:41:12.560-0500 I CONTROL [mongosMain] options: { net: { port: 4356 }, processManagement: { fork: true }, security: { keyFile: "/data/servers/mongodb/etc/keyfile" }, sharding: { configDB: "tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307" }, systemLog: { destination: "file", logAppend: true, path: "/data/servers/mongodb/logs/history_mongos.log", quiet: true } } 2017-01-31T11:41:12.614-0500 I NETWORK [mongosMain] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-31T11:41:12.747-0500 I NETWORK [mongosMain] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-31T11:41:12.749-0500 I NETWORK [mongosMain] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-31T11:41:12.929-0500 I SHARDING [Balancer] about to contact config servers and shards 2017-01-31T11:41:12.929-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-31T11:41:12.932-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-31T11:41:12.935-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-31T11:41:12.958-0500 I NETWORK [Balancer] starting new replica set monitor for replica set TT-RS01 with seeds tdb-a01.white.xxx.com:4308,tdb-m01.white.xxx.com:4308 2017-01-31T11:41:12.958-0500 I NETWORK [ReplicaSetMonitorWatcher] starting 2017-01-31T11:41:12.961-0500 I NETWORK [mongosMain] waiting for connections on port 4356 2017-01-31T11:41:12.988-0500 I NETWORK [Balancer] starting new replica set monitor for replica set TT-RS02 with seeds tdb-a02.white.xxx.com:4308,tdb-m02.white.xxx.com:4308 2017-01-31T11:41:13.020-0500 I NETWORK [Balancer] starting new replica set monitor for replica set TT-RS03 with seeds tdb-a03.white.xxx.com:4308,tdb-m03.white.xxx.com:4308 2017-01-31T11:41:13.062-0500 I NETWORK [Balancer] starting new replica set monitor for replica set TT-RS04 with seeds tdb-a04.white.xxx.com:4308,tdb-m04.white.xxx.com:4308 2017-01-31T11:41:13.077-0500 I NETWORK [Balancer] starting new replica set monitor for replica set TT-RS05 with seeds tdb-a05.white.xxx.com:4308,tdb-m05.white.xxx.com:4308 2017-01-31T11:41:13.107-0500 I NETWORK [Balancer] starting new replica set monitor for replica set TT-RS06 with seeds tdb-a06.white.xxx.com:4308,tdb-m06.white.xxx.com:4308 2017-01-31T11:41:13.122-0500 I NETWORK [Balancer] starting new replica set monitor for replica set TT-RS07 with seeds tdb-a07.white.xxx.com:4308,tdb-m07.white.xxx.com:4308 2017-01-31T11:41:13.159-0500 I NETWORK [Balancer] starting new replica set monitor for replica set TT-RS08 with seeds tdb-a08.white.xxx.com:4308,tdb-m08.white.xxx.com:4308 2017-01-31T11:41:13.194-0500 I NETWORK [Balancer] starting new replica set monitor for replica set TT-RS09 with seeds tdb-a09.white.xxx.com:4308,tdb-m09.white.xxx.com:4308 2017-01-31T11:41:13.206-0500 I NETWORK [Balancer] starting new replica set monitor for replica set TT-RS10 with seeds tdb-a10.white.xxx.com:4308,tdb-m10.white.xxx.com:4308 2017-01-31T11:41:13.218-0500 I NETWORK [Balancer] starting new replica set monitor for replica set TT-RS11 with seeds tdb-a11.white.xxx.com:4308,tdb-m11.white.xxx.com:4308 2017-01-31T11:41:13.254-0500 I NETWORK [Balancer] starting new replica set monitor for replica set TT-RS12 with seeds tdb-a12.white.xxx.com:4308,tdb-m12.white.xxx.com:4308 2017-01-31T11:41:13.287-0500 I NETWORK [Balancer] starting new replica set monitor for replica set TT-RS13 with seeds tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308 2017-01-31T11:41:13.299-0500 I NETWORK [Balancer] starting new replica set monitor for replica set TT-RS14 with seeds tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308 2017-01-31T11:41:13.311-0500 I NETWORK [Balancer] starting new replica set monitor for replica set TT-RS15 with seeds tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308 2017-01-31T11:41:13.325-0500 I NETWORK [Balancer] starting new replica set monitor for replica set TT-RS16 with seeds tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308 2017-01-31T11:41:13.338-0500 I NETWORK [Balancer] starting new replica set monitor for replica set TT-RS17 with seeds tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308 2017-01-31T11:41:13.352-0500 I NETWORK [Balancer] starting new replica set monitor for replica set TT-RS18 with seeds tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308 2017-01-31T11:41:13.365-0500 I NETWORK [Balancer] starting new replica set monitor for replica set TT-RS19 with seeds tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308 2017-01-31T11:41:13.398-0500 I NETWORK [Balancer] starting new replica set monitor for replica set TT-RS20 with seeds tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308 2017-01-31T11:41:13.410-0500 I NETWORK [Balancer] starting new replica set monitor for replica set TT-RS21 with seeds tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308 2017-01-31T11:41:13.422-0500 I NETWORK [Balancer] starting new replica set monitor for replica set TT-RS22 with seeds tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308 2017-01-31T11:41:13.473-0500 I SHARDING [Balancer] config servers and shards contacted successfully 2017-01-31T11:41:13.473-0500 I SHARDING [Balancer] balancer id: its-a51.white.xxx.com:4356 started at Jan 31 11:41:13 2017-01-31T11:41:19.804-0500 I SHARDING [conn1] ChunkManager: time to load chunks for historyDb.History: 684ms sequenceNumber: 2 version: 3285|25||55c0dbaf5b591f0b0cfcee5f based on: (empty) 2017-01-31T13:24:02.997-0500 I NETWORK [Balancer] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.74.102.160:4307) 2017-01-31T13:24:02.997-0500 I NETWORK [Balancer] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.74.102.160:4307) 2017-01-31T13:24:02.997-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-31T13:24:03.001-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-31T13:24:03.002-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-31T13:24:03.060-0500 I NETWORK [Balancer] Detected bad connection created at 1485880873516667 microSec, clearing pool for tconfigdb-m01.db.xxx.com:4307 of 0 connections 2017-01-31T13:24:03.061-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-31T13:24:03.064-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-31T13:24:03.065-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-31T13:24:13.037-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.102.160:4307) 2017-01-31T13:25:12.975-0500 I NETWORK [UserCacheInvalidator] Socket closed remotely, no longer connected (idle 9 secs, remote host 10.72.110.202:4307) 2017-01-31T13:25:12.975-0500 I NETWORK [UserCacheInvalidator] Socket closed remotely, no longer connected (idle 9 secs, remote host 10.72.110.202:4307) 2017-01-31T13:25:12.975-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-31T13:25:12.979-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-31T13:25:12.981-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.72.110.202:4307, reason: errno:111 Connection refused 2017-01-31T13:25:12.981-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connect fail to: tconfigdb-d01.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-d01.db.xxx.com:4307 (10.72.110.202), connection attempt failed 2017-01-31T13:25:12.981-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-31T13:25:12.995-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-d01.db.xxx.com:4307 (10.72.110.202) failed 2017-01-31T13:25:12.997-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.72.110.202:4307, reason: errno:111 Connection refused 2017-01-31T13:25:12.997-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-d01.db.xxx.com:4307 (10.72.110.202) failed failed couldn't connect to server tconfigdb-d01.db.xxx.com:4307 (10.72.110.202), connection attempt failed 2017-01-31T13:25:13.038-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.110.202:4307) 2017-01-31T13:25:13.416-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-31T13:25:13.544-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-31T13:25:13.546-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-31T13:25:13.630-0500 I NETWORK [Balancer] Detected bad connection created at 1485880873506431 microSec, clearing pool for tconfigdb-d01.db.xxx.com:4307 of 0 connections 2017-01-31T13:25:13.630-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-31T13:25:13.636-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-31T13:25:13.640-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-31T13:26:54.070-0500 I NETWORK [Balancer] Socket closed remotely, no longer connected (idle 12 secs, remote host 10.74.137.2:4307) 2017-01-31T13:26:54.070-0500 I NETWORK [Balancer] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.74.137.2:4307) 2017-01-31T13:26:54.071-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-31T13:26:54.074-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-31T13:26:54.076-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-31T13:26:54.152-0500 I NETWORK [Balancer] Detected bad connection created at 1485880873493988 microSec, clearing pool for tconfigdb-m02.db.xxx.com:4307 of 0 connections 2017-01-31T13:26:54.155-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-31T13:26:54.159-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-31T13:26:54.161-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-31T13:27:12.980-0500 I ACCESS [UserCacheInvalidator] User cache generation changed from 588f6eae4ee4ff0e5e4d14f5 to 5890d6eb02d4b6d65850574f; invalidating user cache 2017-01-31T13:27:13.041-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.137.2:4307) 2017-01-31T13:49:37.259-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.74.74.142:4308) 2017-01-31T13:49:37.263-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.74.74.142:4308, reason: errno:111 Connection refused 2017-01-31T13:51:38.808-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.72.116.167:4308) 2017-01-31T13:51:38.810-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.116.167:4308, reason: errno:111 Connection refused 2017-01-31T13:51:48.898-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.116.167:4308, reason: errno:111 Connection refused 2017-01-31T13:51:58.988-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.116.167:4308, reason: errno:111 Connection refused 2017-01-31T13:52:09.124-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.116.167:4308, reason: errno:111 Connection refused 2017-01-31T13:52:19.220-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.116.167:4308, reason: errno:111 Connection refused 2017-01-31T13:52:29.309-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.116.167:4308, reason: errno:111 Connection refused 2017-01-31T13:52:39.401-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.116.167:4308, reason: errno:111 Connection refused 2017-01-31T13:52:49.593-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.116.167:4308, reason: errno:111 Connection refused 2017-01-31T13:52:59.686-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.116.167:4308, reason: errno:111 Connection refused 2017-01-31T13:53:09.775-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.116.167:4308, reason: errno:111 Connection refused 2017-01-31T13:53:19.867-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.116.167:4308, reason: errno:111 Connection refused 2017-01-31T13:53:29.954-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.116.167:4308, reason: errno:111 Connection refused 2017-01-31T13:53:40.047-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.116.167:4308, reason: errno:111 Connection refused 2017-01-31T13:53:50.141-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.116.167:4308, reason: errno:111 Connection refused 2017-01-31T13:56:01.666-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.72.86.141:4308) 2017-01-31T13:56:01.669-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.141:4308, reason: errno:111 Connection refused 2017-01-31T13:56:11.756-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.141:4308, reason: errno:111 Connection refused 2017-01-31T13:59:44.372-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.72.86.141:4308) 2017-01-31T14:00:34.883-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.74.74.144:4308) 2017-01-31T14:00:34.887-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.74.74.144:4308, reason: errno:111 Connection refused 2017-01-31T14:02:13.080-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 8 secs, remote host 10.72.86.143:4308) 2017-01-31T14:02:15.997-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.143:4308, reason: errno:111 Connection refused 2017-01-31T14:02:56.480-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.74.74.149:4308) 2017-01-31T14:02:56.484-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.74.74.149:4308, reason: errno:111 Connection refused 2017-01-31T14:03:57.098-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.72.116.170:4308) 2017-01-31T14:04:47.758-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.72.116.169:4308) 2017-01-31T14:04:47.760-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.116.169:4308, reason: errno:111 Connection refused 2017-01-31T14:05:08.005-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 11 secs, remote host 10.74.74.151:4308) 2017-01-31T14:05:08.010-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.74.74.151:4308, reason: errno:111 Connection refused 2017-01-31T14:05:18.105-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.74.74.151:4308, reason: errno:111 Connection refused 2017-01-31T14:05:28.202-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.74.74.151:4308, reason: errno:111 Connection refused 2017-01-31T14:05:38.294-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.74.74.151:4308, reason: errno:111 Connection refused 2017-01-31T14:06:18.837-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 5 secs, remote host 10.74.74.156:4308) 2017-01-31T14:06:18.842-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.74.74.156:4308, reason: errno:111 Connection refused 2017-01-31T14:06:28.935-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.74.74.156:4308, reason: errno:111 Connection refused 2017-01-31T14:06:39.031-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.74.74.156:4308, reason: errno:111 Connection refused 2017-01-31T14:06:49.095-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.72.86.142:4308) 2017-01-31T14:06:49.097-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.142:4308, reason: errno:111 Connection refused 2017-01-31T14:06:49.122-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.74.74.156:4308, reason: errno:111 Connection refused 2017-01-31T14:06:59.188-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.142:4308, reason: errno:111 Connection refused 2017-01-31T14:07:09.329-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.142:4308, reason: errno:111 Connection refused 2017-01-31T14:07:19.420-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.142:4308, reason: errno:111 Connection refused 2017-01-31T14:07:29.516-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.142:4308, reason: errno:111 Connection refused 2017-01-31T14:07:59.939-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.72.86.142:4308) 2017-01-31T14:09:47.079-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 11 secs, remote host 10.72.116.168:4308) 2017-01-31T14:09:47.081-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.116.168:4308, reason: errno:111 Connection refused 2017-01-31T14:09:47.098-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.74.98.169:4308) 2017-01-31T14:09:47.101-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.74.98.169:4308, reason: errno:111 Connection refused 2017-01-31T14:10:57.892-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.74.98.170:4308) 2017-01-31T14:10:57.896-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.74.98.170:4308, reason: errno:111 Connection refused 2017-01-31T14:10:57.946-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.74.98.171:4308) 2017-01-31T14:10:57.950-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.74.98.171:4308, reason: errno:111 Connection refused 2017-01-31T14:11:13.089-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.74.98.171:4308, reason: errno:111 Connection refused 2017-01-31T14:11:23.230-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.74.98.171:4308, reason: errno:111 Connection refused 2017-01-31T14:11:33.374-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.74.98.171:4308, reason: errno:111 Connection refused 2017-01-31T14:11:43.576-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.74.98.171:4308, reason: errno:111 Connection refused 2017-01-31T14:12:00.436-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket recv() errno:104 Connection reset by peer 10.74.98.171:4308 2017-01-31T14:12:00.436-0500 I NETWORK [ReplicaSetMonitorWatcher] SocketException: remote: 10.74.98.171:4308 error: 9001 socket exception [RECV_ERROR] server [10.74.98.171:4308] 2017-01-31T14:12:00.436-0500 I NETWORK [ReplicaSetMonitorWatcher] DBClientCursor::init call() failed 2017-01-31T14:14:02.019-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 11 secs, remote host 10.74.74.146:4308) 2017-01-31T14:14:02.023-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.74.74.146:4308, reason: errno:111 Connection refused 2017-01-31T14:14:12.092-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.74.74.147:4308) 2017-01-31T14:14:12.096-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.74.74.147:4308, reason: errno:111 Connection refused 2017-01-31T14:14:12.102-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.74.74.148:4308) 2017-01-31T14:14:12.106-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.74.74.148:4308, reason: errno:111 Connection refused 2017-01-31T14:14:12.118-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.74.74.146:4308, reason: errno:111 Connection refused 2017-01-31T14:15:22.903-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.72.86.152:4308) 2017-01-31T14:15:22.906-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.152:4308, reason: errno:111 Connection refused 2017-01-31T14:15:43.164-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.74.74.153:4308) 2017-01-31T14:15:43.167-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.74.74.153:4308, reason: errno:111 Connection refused 2017-01-31T14:16:43.976-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.74.90.110:4308) 2017-01-31T14:16:43.980-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.74.90.110:4308, reason: errno:111 Connection refused 2017-01-31T14:17:34.724-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.72.45.249:4308) 2017-01-31T14:17:34.727-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.45.249:4308, reason: errno:111 Connection refused 2017-01-31T14:17:44.820-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.45.249:4308, reason: errno:111 Connection refused 2017-01-31T15:04:33.228-0500 I NETWORK [conn46] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-01-31T15:04:33.233-0500 I NETWORK [conn46] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-01-31T15:04:33.309-0500 I NETWORK [conn46] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-01-31T22:21:02.198-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.72.116.166:4308) 2017-01-31T22:21:02.209-0500 W NETWORK [ReplicaSetMonitorWatcher] No primary detected for set TT-RS01 2017-01-31T22:21:13.659-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.116.166:4308) 2017-01-31T22:21:13.659-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.116.166:4308) 2017-01-31T22:21:13.659-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.116.166:4308) 2017-01-31T22:21:13.659-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.116.166:4308) 2017-01-31T22:21:13.659-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.116.166:4308) 2017-01-31T22:21:13.660-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.116.166:4308) 2017-01-31T22:21:13.660-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.116.166:4308) 2017-01-31T22:35:22.282-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.72.116.166:4308) 2017-01-31T22:35:22.286-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.116.166:4308, reason: errno:111 Connection refused 2017-01-31T22:37:54.103-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.74.74.141:4308) 2017-01-31T22:38:13.680-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 54 secs, remote host 10.74.74.141:4308) 2017-01-31T22:38:13.680-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.141:4308) 2017-01-31T22:38:13.680-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 54 secs, remote host 10.74.74.141:4308) 2017-01-31T22:38:13.680-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.141:4308) 2017-01-31T22:38:13.681-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.141:4308) 2017-01-31T22:38:13.681-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 54 secs, remote host 10.74.74.141:4308) 2017-01-31T22:38:13.681-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.141:4308) 2017-01-31T22:48:21.523-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.74.74.143:4308) 2017-01-31T22:48:21.546-0500 W NETWORK [ReplicaSetMonitorWatcher] No primary detected for set TT-RS03 2017-01-31T22:49:13.693-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.143:4308) 2017-01-31T22:49:13.693-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.143:4308) 2017-01-31T22:49:13.694-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.143:4308) 2017-01-31T22:49:13.694-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.143:4308) 2017-01-31T22:49:13.694-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.143:4308) 2017-01-31T22:49:13.694-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.143:4308) 2017-01-31T22:49:13.694-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.143:4308) 2017-01-31T22:53:13.699-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 61 secs, remote host 10.72.66.114:4308) 2017-01-31T22:53:13.699-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 61 secs, remote host 10.72.66.114:4308) 2017-01-31T22:53:13.699-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.66.114:4308) 2017-01-31T22:53:13.699-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.66.114:4308) 2017-01-31T22:53:13.699-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 9 secs, remote host 10.72.66.114:4308) 2017-01-31T23:02:00.472-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.74.74.145:4308) 2017-01-31T23:02:13.709-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.145:4308) 2017-01-31T23:02:13.709-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.145:4308) 2017-01-31T23:02:13.709-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.145:4308) 2017-01-31T23:02:13.709-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.145:4308) 2017-01-31T23:02:13.709-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.145:4308) 2017-01-31T23:02:13.710-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.145:4308) 2017-01-31T23:08:13.717-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 6 secs, remote host 10.72.86.144:4308) 2017-01-31T23:08:13.717-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.144:4308) 2017-01-31T23:08:13.717-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 6 secs, remote host 10.72.86.144:4308) 2017-01-31T23:08:13.717-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.144:4308) 2017-01-31T23:08:13.718-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.144:4308) 2017-01-31T23:08:13.718-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 19 secs, remote host 10.72.86.144:4308) 2017-01-31T23:08:13.718-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 9 secs, remote host 10.72.86.144:4308) 2017-01-31T23:14:59.252-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.74.74.152:4308) 2017-01-31T23:15:13.725-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.152:4308) 2017-01-31T23:15:13.725-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.152:4308) 2017-01-31T23:15:13.726-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.152:4308) 2017-01-31T23:15:13.726-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.152:4308) 2017-01-31T23:15:13.726-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.152:4308) 2017-01-31T23:15:13.726-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.152:4308) 2017-01-31T23:15:13.726-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.152:4308) 2017-01-31T23:16:50.665-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.74.74.150:4308) 2017-01-31T23:16:50.682-0500 W NETWORK [ReplicaSetMonitorWatcher] No primary detected for set TT-RS08 2017-01-31T23:17:13.728-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.150:4308) 2017-01-31T23:17:13.729-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.150:4308) 2017-01-31T23:17:13.729-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.150:4308) 2017-01-31T23:17:13.729-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.150:4308) 2017-01-31T23:17:13.730-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.150:4308) 2017-01-31T23:17:13.730-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.150:4308) 2017-01-31T23:23:13.736-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.146:4308) 2017-01-31T23:23:13.736-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.146:4308) 2017-01-31T23:23:13.736-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.146:4308) 2017-01-31T23:23:13.737-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.146:4308) 2017-01-31T23:23:13.737-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.146:4308) 2017-01-31T23:23:13.737-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.146:4308) 2017-01-31T23:23:13.737-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.146:4308) 2017-01-31T23:23:13.738-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.146:4308) 2017-01-31T23:23:13.738-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 9 secs, remote host 10.72.86.146:4308) 2017-01-31T23:27:27.887-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 14 secs, remote host 10.72.116.171:4308) 2017-01-31T23:28:13.744-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.116.171:4308) 2017-01-31T23:28:13.745-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.116.171:4308) 2017-01-31T23:28:13.745-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.116.171:4308) 2017-01-31T23:28:13.746-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.116.171:4308) 2017-01-31T23:28:13.746-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.116.171:4308) 2017-02-01T22:02:15.487-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 45 secs, remote host 10.74.74.155:4308) 2017-02-01T22:02:15.487-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.155:4308) 2017-02-01T22:02:15.488-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 45 secs, remote host 10.74.74.155:4308) 2017-02-01T22:02:15.488-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.155:4308) 2017-02-01T22:02:15.488-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.155:4308) 2017-02-01T22:02:15.488-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.155:4308) 2017-02-01T22:02:15.488-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.155:4308) 2017-02-01T22:02:15.488-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.74.74.155:4308) 2017-02-01T22:10:11.779-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.74.74.157:4308) 2017-02-01T22:10:11.798-0500 W NETWORK [ReplicaSetMonitorWatcher] No primary detected for set TT-RS12 2017-02-01T22:10:15.499-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.157:4308) 2017-02-01T22:10:15.499-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.157:4308) 2017-02-01T22:10:15.499-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.157:4308) 2017-02-01T22:10:15.499-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.157:4308) 2017-02-01T22:10:15.499-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.157:4308) 2017-02-01T22:10:15.500-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.157:4308) 2017-02-01T22:10:15.500-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.157:4308) 2017-02-01T22:15:15.417-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.72.86.145:4308) 2017-02-01T22:15:15.435-0500 W NETWORK [ReplicaSetMonitorWatcher] No primary detected for set TT-RS13 2017-02-01T22:15:15.505-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 36 secs, remote host 10.72.86.145:4308) 2017-02-01T22:15:15.505-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.145:4308) 2017-02-01T22:15:15.506-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 36 secs, remote host 10.72.86.145:4308) 2017-02-01T22:15:15.506-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.145:4308) 2017-02-01T22:15:15.506-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.145:4308) 2017-02-01T22:15:15.506-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.145:4308) 2017-02-01T22:15:15.507-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.145:4308) 2017-02-01T22:18:15.510-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.151:4308) 2017-02-01T22:18:15.510-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.151:4308) 2017-02-01T22:18:15.511-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.151:4308) 2017-02-01T22:18:15.511-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.151:4308) 2017-02-01T22:18:15.511-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.151:4308) 2017-02-01T22:18:15.511-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.151:4308) 2017-02-01T22:18:15.511-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 8 secs, remote host 10.72.86.151:4308) 2017-02-01T22:22:15.517-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.149:4308) 2017-02-01T22:22:15.518-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.149:4308) 2017-02-01T22:22:15.518-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.149:4308) 2017-02-01T22:22:15.518-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.149:4308) 2017-02-01T22:22:15.518-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.149:4308) 2017-02-01T22:22:15.518-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.149:4308) 2017-02-01T22:22:15.518-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.149:4308) 2017-02-01T22:22:15.518-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 5 secs, remote host 10.72.86.149:4308) 2017-02-01T22:24:11.841-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.72.86.147:4308) 2017-02-01T22:24:15.521-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 25 secs, remote host 10.72.86.147:4308) 2017-02-01T22:24:15.521-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.147:4308) 2017-02-01T22:24:15.521-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 25 secs, remote host 10.72.86.147:4308) 2017-02-01T22:24:15.521-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.147:4308) 2017-02-01T22:24:15.521-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.147:4308) 2017-02-01T22:24:15.522-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.147:4308) 2017-02-01T22:24:15.522-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.147:4308) 2017-02-01T22:24:15.522-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.147:4308) 2017-02-01T22:24:15.522-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.147:4308) 2017-02-01T22:24:15.523-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.147:4308) 2017-02-01T22:24:15.523-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 25 secs, remote host 10.72.86.147:4308) 2017-02-01T22:24:15.523-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.147:4308) 2017-02-01T22:26:13.285-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.72.86.150:4308) 2017-02-01T22:26:15.525-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.150:4308) 2017-02-01T22:26:15.525-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.150:4308) 2017-02-01T22:26:15.525-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.150:4308) 2017-02-01T22:26:15.525-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.150:4308) 2017-02-01T22:26:15.525-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.150:4308) 2017-02-01T22:26:15.526-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.150:4308) 2017-02-01T22:26:15.526-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.150:4308) 2017-02-01T22:31:37.301-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.72.86.148:4308) 2017-02-01T22:31:37.311-0500 W NETWORK [ReplicaSetMonitorWatcher] No primary detected for set TT-RS18 2017-02-01T22:32:15.532-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.148:4308) 2017-02-01T22:32:15.532-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.148:4308) 2017-02-01T22:32:15.532-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.148:4308) 2017-02-01T22:32:15.532-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.148:4308) 2017-02-01T22:32:15.533-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.148:4308) 2017-02-01T22:32:15.533-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.148:4308) 2017-02-01T22:32:15.533-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.148:4308) 2017-02-01T22:37:11.252-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 11 secs, remote host 10.74.74.154:4308) 2017-02-01T22:37:15.539-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.154:4308) 2017-02-01T22:37:15.539-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.154:4308) 2017-02-01T22:37:15.540-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.154:4308) 2017-02-01T22:37:15.540-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.154:4308) 2017-02-01T22:37:15.541-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.154:4308) 2017-02-01T22:37:15.541-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.154:4308) 2017-02-01T22:37:15.541-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.154:4308) 2017-02-01T22:37:31.593-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.72.86.153:4308) 2017-02-01T22:37:31.633-0500 W NETWORK [ReplicaSetMonitorWatcher] No primary detected for set TT-RS20 2017-02-01T22:38:15.542-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.153:4308) 2017-02-01T22:38:15.542-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.153:4308) 2017-02-01T22:38:15.542-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.153:4308) 2017-02-01T22:38:15.543-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.153:4308) 2017-02-01T22:38:15.543-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.153:4308) 2017-02-01T22:38:15.543-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.153:4308) 2017-02-01T22:38:15.544-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.153:4308) 2017-02-01T22:38:15.544-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.86.153:4308) 2017-02-01T22:40:03.441-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.72.76.104:4308) 2017-02-01T22:40:15.546-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.76.104:4308) 2017-02-01T22:40:15.546-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.76.104:4308) 2017-02-01T22:40:15.546-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.76.104:4308) 2017-02-01T22:40:15.546-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.76.104:4308) 2017-02-01T22:40:15.546-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.76.104:4308) 2017-02-01T22:40:15.546-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.72.76.104:4308) 2017-02-01T22:43:36.070-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 11 secs, remote host 10.74.74.159:4308) 2017-02-01T22:44:15.550-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.159:4308) 2017-02-01T22:44:15.550-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.159:4308) 2017-02-01T22:44:15.550-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.159:4308) 2017-02-01T22:44:15.550-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.159:4308) 2017-02-01T22:44:15.550-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.159:4308) 2017-02-01T22:44:15.551-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 60 secs, remote host 10.74.74.159:4308) 2017-02-02T09:18:11.344-0500 I NETWORK [ReplicaSetMonitorWatcher] DBClientCursor::init call() failed 2017-02-02T09:18:11.344-0500 I NETWORK [ReplicaSetMonitorWatcher] Detected bad connection created at 1485920132462475 microSec, clearing pool for tdb-a01.white.xxx.com:4308 of 0 connections 2017-02-02T09:18:11.345-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.74.74.141:4308) 2017-02-02T09:18:11.350-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.74.74.141:4308, reason: errno:111 Connection refused 2017-02-02T09:18:11.374-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.74.74.143:4308) 2017-02-02T09:18:11.378-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.74.74.143:4308, reason: errno:111 Connection refused 2017-02-02T09:18:21.636-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.74.74.143:4308, reason: errno:111 Connection refused 2017-02-02T09:18:31.733-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.74.74.143:4308, reason: errno:111 Connection refused 2017-02-02T09:18:41.907-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.74.74.143:4308, reason: errno:111 Connection refused 2017-02-02T09:18:52.010-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.74.74.143:4308, reason: errno:111 Connection refused 2017-02-02T09:19:02.103-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.74.74.143:4308, reason: errno:111 Connection refused 2017-02-02T09:19:12.200-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.74.74.143:4308, reason: errno:111 Connection refused 2017-02-02T09:37:24.637-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.72.86.144:4308) 2017-02-02T09:37:24.639-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.144:4308, reason: errno:111 Connection refused 2017-02-02T09:38:35.500-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.72.66.114:4308) 2017-02-02T09:38:35.502-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.66.114:4308, reason: errno:111 Connection refused 2017-02-02T09:38:35.530-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.74.74.145:4308) 2017-02-02T09:38:35.534-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.74.74.145:4308, reason: errno:111 Connection refused 2017-02-02T09:38:45.598-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.66.114:4308, reason: errno:111 Connection refused 2017-02-02T09:38:55.734-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.66.114:4308, reason: errno:111 Connection refused 2017-02-02T09:39:05.830-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.66.114:4308, reason: errno:111 Connection refused 2017-02-02T09:41:47.865-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.74.74.152:4308) 2017-02-02T09:41:47.870-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.74.74.152:4308, reason: errno:111 Connection refused 2017-02-02T09:41:47.917-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.72.86.146:4308) 2017-02-02T09:41:47.919-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.146:4308, reason: errno:111 Connection refused 2017-02-02T09:41:47.927-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.74.74.150:4308) 2017-02-02T09:41:47.931-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.74.74.150:4308, reason: errno:111 Connection refused 2017-02-02T09:41:57.971-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.74.74.152:4308, reason: errno:111 Connection refused 2017-02-02T09:42:08.155-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.74.74.152:4308, reason: errno:111 Connection refused 2017-02-02T09:42:18.258-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.74.74.152:4308, reason: errno:111 Connection refused 2017-02-02T09:45:10.306-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.72.116.171:4308) 2017-02-02T09:45:10.309-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.116.171:4308, reason: errno:111 Connection refused 2017-02-02T09:45:16.408-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 6 secs, remote host 10.74.74.155:4308) 2017-02-02T09:45:16.408-0500 I NETWORK [PeriodicTaskRunner] Socket closed remotely, no longer connected (idle 6 secs, remote host 10.74.74.157:4308) 2017-02-02T09:45:20.342-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.74.74.157:4308, reason: errno:111 Connection refused 2017-02-02T09:45:20.382-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.74.74.155:4308, reason: errno:111 Connection refused 2017-02-02T09:45:30.468-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.74.74.157:4308, reason: errno:111 Connection refused 2017-02-02T09:45:40.737-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.74.74.157:4308, reason: errno:111 Connection refused 2017-02-02T09:45:50.838-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.74.74.157:4308, reason: errno:111 Connection refused 2017-02-02T09:47:32.159-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.72.86.151:4308) 2017-02-02T09:47:32.161-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.151:4308, reason: errno:111 Connection refused 2017-02-02T09:47:42.243-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.72.86.145:4308) 2017-02-02T09:47:42.246-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.145:4308, reason: errno:111 Connection refused 2017-02-02T09:47:42.255-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.151:4308, reason: errno:111 Connection refused 2017-02-02T09:47:42.307-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.72.86.149:4308) 2017-02-02T09:47:42.312-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.149:4308, reason: errno:111 Connection refused 2017-02-02T09:47:52.477-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.151:4308, reason: errno:111 Connection refused 2017-02-02T09:48:02.640-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.151:4308, reason: errno:111 Connection refused 2017-02-02T09:48:12.735-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.151:4308, reason: errno:111 Connection refused 2017-02-02T09:48:22.837-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.151:4308, reason: errno:111 Connection refused 2017-02-02T09:48:33.122-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.151:4308, reason: errno:111 Connection refused 2017-02-02T09:48:43.234-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.151:4308, reason: errno:111 Connection refused 2017-02-02T09:48:53.331-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.151:4308, reason: errno:111 Connection refused 2017-02-02T09:49:03.650-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.151:4308, reason: errno:111 Connection refused 2017-02-02T09:49:13.857-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.151:4308, reason: errno:111 Connection refused 2017-02-02T09:49:23.953-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.151:4308, reason: errno:111 Connection refused 2017-02-02T09:49:34.051-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.151:4308, reason: errno:111 Connection refused 2017-02-02T09:49:44.248-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.151:4308, reason: errno:111 Connection refused 2017-02-02T09:49:54.344-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.151:4308, reason: errno:111 Connection refused 2017-02-02T09:50:04.449-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.151:4308, reason: errno:111 Connection refused 2017-02-02T09:50:14.543-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.151:4308, reason: errno:111 Connection refused 2017-02-02T09:50:24.654-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.151:4308, reason: errno:111 Connection refused 2017-02-02T09:50:34.757-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.151:4308, reason: errno:111 Connection refused 2017-02-02T09:50:44.854-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.151:4308, reason: errno:111 Connection refused 2017-02-02T09:50:54.950-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.151:4308, reason: errno:111 Connection refused 2017-02-02T09:52:05.875-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.72.86.150:4308) 2017-02-02T09:52:05.877-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.150:4308, reason: errno:111 Connection refused 2017-02-02T09:52:05.884-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.72.86.148:4308) 2017-02-02T09:52:05.886-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.148:4308, reason: errno:111 Connection refused 2017-02-02T09:52:05.894-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.72.86.147:4308) 2017-02-02T09:52:05.896-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.147:4308, reason: errno:111 Connection refused 2017-02-02T09:52:15.973-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.150:4308, reason: errno:111 Connection refused 2017-02-02T09:52:15.983-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.148:4308, reason: errno:111 Connection refused 2017-02-02T09:52:26.221-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.150:4308, reason: errno:111 Connection refused 2017-02-02T09:52:26.230-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.148:4308, reason: errno:111 Connection refused 2017-02-02T09:52:36.319-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.150:4308, reason: errno:111 Connection refused 2017-02-02T09:52:36.328-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.148:4308, reason: errno:111 Connection refused 2017-02-02T09:52:46.420-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.150:4308, reason: errno:111 Connection refused 2017-02-02T09:52:46.430-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.148:4308, reason: errno:111 Connection refused 2017-02-02T09:52:56.521-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.150:4308, reason: errno:111 Connection refused 2017-02-02T09:52:56.533-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.148:4308, reason: errno:111 Connection refused 2017-02-02T09:53:06.779-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.150:4308, reason: errno:111 Connection refused 2017-02-02T09:53:06.800-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.148:4308, reason: errno:111 Connection refused 2017-02-02T09:53:16.884-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.150:4308, reason: errno:111 Connection refused 2017-02-02T09:53:16.893-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.148:4308, reason: errno:111 Connection refused 2017-02-02T09:53:26.980-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.150:4308, reason: errno:111 Connection refused 2017-02-02T09:53:26.990-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.148:4308, reason: errno:111 Connection refused 2017-02-02T09:53:37.253-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.150:4308, reason: errno:111 Connection refused 2017-02-02T09:53:37.263-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.148:4308, reason: errno:111 Connection refused 2017-02-02T09:53:47.346-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.150:4308, reason: errno:111 Connection refused 2017-02-02T09:53:47.356-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.148:4308, reason: errno:111 Connection refused 2017-02-02T09:53:57.447-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.150:4308, reason: errno:111 Connection refused 2017-02-02T09:53:57.457-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.148:4308, reason: errno:111 Connection refused 2017-02-02T09:54:07.645-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.150:4308, reason: errno:111 Connection refused 2017-02-02T09:54:07.655-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.148:4308, reason: errno:111 Connection refused 2017-02-02T09:54:17.755-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.150:4308, reason: errno:111 Connection refused 2017-02-02T09:54:17.764-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.148:4308, reason: errno:111 Connection refused 2017-02-02T09:54:27.891-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.148:4308, reason: errno:111 Connection refused 2017-02-02T09:54:37.988-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.148:4308, reason: errno:111 Connection refused 2017-02-02T09:54:48.148-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.148:4308, reason: errno:111 Connection refused 2017-02-02T09:54:58.243-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.148:4308, reason: errno:111 Connection refused 2017-02-02T09:55:08.337-0500 I NETWORK [ReplicaSetMonitorWatcher] DBClientCursor::init call() failed 2017-02-02T09:55:08.337-0500 I NETWORK [ReplicaSetMonitorWatcher] Detected bad connection created at 1486047267852470 microSec, clearing pool for tdb-a17.white.xxx.com:4308 of 0 connections 2017-02-02T09:55:08.347-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.148:4308, reason: errno:111 Connection refused 2017-02-02T09:55:18.470-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.148:4308, reason: errno:111 Connection refused 2017-02-02T09:55:28.612-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.148:4308, reason: errno:111 Connection refused 2017-02-02T09:55:38.709-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.148:4308, reason: errno:111 Connection refused 2017-02-02T09:57:29.976-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 13 secs, remote host 10.74.74.159:4308) 2017-02-02T09:57:29.979-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.74.74.159:4308, reason: errno:111 Connection refused 2017-02-02T09:57:39.989-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.74.74.154:4308) 2017-02-02T09:57:39.994-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.74.74.154:4308, reason: errno:111 Connection refused 2017-02-02T09:57:39.996-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 10 secs, remote host 10.72.76.104:4308) 2017-02-02T09:57:39.998-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.76.104:4308, reason: errno:111 Connection refused 2017-02-02T09:57:40.019-0500 I NETWORK [ReplicaSetMonitorWatcher] Socket closed remotely, no longer connected (idle 11 secs, remote host 10.72.86.153:4308) 2017-02-02T09:57:40.022-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.153:4308, reason: errno:111 Connection refused 2017-02-02T09:57:50.328-0500 W NETWORK [ReplicaSetMonitorWatcher] Failed to connect to 10.72.86.153:4308, reason: errno:111 Connection refused 2017-02-02T22:50:14.351-0500 I NETWORK [UserCacheInvalidator] Socket recv() timeout 10.74.137.2:4307 2017-02-02T22:50:14.351-0500 I NETWORK [UserCacheInvalidator] SocketException: remote: 10.74.137.2:4307 error: 9001 socket exception [RECV_TIMEOUT] server [10.74.137.2:4307] 2017-02-02T22:50:14.351-0500 I NETWORK [UserCacheInvalidator] DBClientCursor::init call() failed 2017-02-02T22:50:14.351-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed no data 2017-02-02T22:50:14.353-0500 I ACCESS [UserCacheInvalidator] User cache generation changed from 5890d6eb02d4b6d65850574f to 5890d689cd3809e9cc360506; invalidating user cache 2017-02-02T22:50:14.354-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:50:19.355-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:50:19.355-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:50:19.356-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:50:44.354-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T22:50:49.020-0500 I NETWORK [conn64] Socket recv() timeout 10.74.137.2:4307 2017-02-02T22:50:49.021-0500 I NETWORK [conn64] SocketException: remote: 10.74.137.2:4307 error: 9001 socket exception [RECV_TIMEOUT] server [10.74.137.2:4307] 2017-02-02T22:50:49.021-0500 I NETWORK [conn64] DBClientCursor::init call() failed 2017-02-02T22:50:49.021-0500 I NETWORK [conn64] query on admin.$cmd: { getParameter: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed no data 2017-02-02T22:50:49.023-0500 I NETWORK [conn64] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:50:49.402-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:50:49.402-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:50:49.402-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T22:50:49.457-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T22:50:49.465-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:50:54.025-0500 W NETWORK [conn64] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:50:54.025-0500 I NETWORK [conn64] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:50:54.025-0500 I NETWORK [conn64] query on admin.$cmd: { getParameter: 1, authSchemaVersion: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:50:54.026-0500 I NETWORK [conn64] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T22:50:54.466-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:50:54.466-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:50:54.541-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:50:55.308-0500 I NETWORK Socket recv() timeout 10.74.137.2:4307 2017-02-02T22:50:55.309-0500 I NETWORK SocketException: remote: 10.74.137.2:4307 error: 9001 socket exception [RECV_TIMEOUT] server [10.74.137.2:4307] 2017-02-02T22:50:55.309-0500 I NETWORK DBClientCursor::init call() failed 2017-02-02T22:50:55.320-0500 W SHARDING couldn't check dbhash on config server tconfigdb-m02.db.xxx.com:4307 :: caused by :: 10276 DBClientBase::findN: transport error: tconfigdb-m02.db.xxx.com:4307 ns: config.$cmd query: { dbhash: 1, collections: [ "chunks", "databases", "collections", "shards", "version" ] } 2017-02-02T22:50:59.028-0500 W NETWORK [conn64] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:50:59.028-0500 I NETWORK [conn64] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:50:59.028-0500 I NETWORK [conn64] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T22:50:59.031-0500 I NETWORK [conn64] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T22:50:59.037-0500 I NETWORK [conn64] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:50:59.543-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:50:59.543-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:50:59.543-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:50:59.545-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:51:04.038-0500 W NETWORK [conn64] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:51:04.038-0500 I NETWORK [conn64] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:51:04.089-0500 I NETWORK [conn64] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:51:04.546-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:51:04.547-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:51:04.547-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:51:09.091-0500 W NETWORK [conn64] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:51:09.091-0500 I NETWORK [conn64] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:51:09.091-0500 I NETWORK [conn64] query on admin.$cmd: { usersInfo: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:51:09.093-0500 I NETWORK [conn64] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:51:14.159-0500 W NETWORK [conn64] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:51:14.159-0500 I NETWORK [conn64] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:51:14.159-0500 I NETWORK [conn64] query on admin.$cmd: { usersInfo: [ { user: "its_rw", db: "historyDb" } ], showPrivileges: true, showCredentials: true } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:51:14.353-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T22:51:19.355-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:51:19.355-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:51:19.355-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T22:51:19.357-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T22:51:19.363-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:51:24.365-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:51:24.365-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:51:24.438-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:51:29.439-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:51:29.439-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:51:29.440-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:51:29.441-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:51:34.449-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:51:34.449-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:51:34.449-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:51:44.353-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T22:51:49.355-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:51:49.355-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:51:49.355-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T22:51:49.357-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T22:51:49.364-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:51:54.365-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:51:54.365-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:51:54.440-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:51:59.441-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:51:59.441-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:51:59.441-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:51:59.443-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:52:00.381-0500 W NETWORK Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:52:00.381-0500 W SHARDING couldn't check dbhash on config server tconfigdb-m02.db.xxx.com:4307 :: caused by :: 11002 socket exception [CONNECT_ERROR] server [tconfigdb-m02.db.xxx.com:4307] connection pool error: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:52:04.445-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:52:04.445-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:52:04.445-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:52:14.353-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T22:52:19.355-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:52:19.355-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:52:19.355-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T22:52:19.357-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T22:52:19.363-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:52:24.364-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:52:24.364-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:52:24.417-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:52:29.419-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:52:29.419-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:52:29.419-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:52:29.421-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:52:34.423-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:52:34.423-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:52:34.423-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:52:44.353-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T22:52:49.355-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:52:49.355-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:52:49.355-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T22:52:49.357-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T22:52:49.364-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:52:54.367-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:52:54.367-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:52:54.418-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:52:59.420-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:52:59.420-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:52:59.420-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:52:59.422-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:53:04.424-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:53:04.424-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:53:04.424-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:53:05.388-0500 W NETWORK Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:53:05.388-0500 W SHARDING couldn't check dbhash on config server tconfigdb-m02.db.xxx.com:4307 :: caused by :: 11002 socket exception [CONNECT_ERROR] server [tconfigdb-m02.db.xxx.com:4307] connection pool error: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:53:14.354-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T22:53:19.355-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:53:19.355-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:53:19.355-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T22:53:19.358-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T22:53:19.365-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:53:24.366-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:53:24.366-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:53:24.431-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:53:29.433-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:53:29.433-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:53:29.433-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:53:29.435-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:53:33.244-0500 I NETWORK [conn728] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T22:53:34.436-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:53:34.436-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:53:34.436-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:53:38.246-0500 W NETWORK [conn728] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:53:38.246-0500 I NETWORK [conn728] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:53:38.246-0500 I NETWORK [conn728] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T22:53:38.248-0500 I NETWORK [conn728] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T22:53:38.255-0500 I NETWORK [conn728] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:53:43.257-0500 W NETWORK [conn728] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:53:43.257-0500 I NETWORK [conn728] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:53:43.318-0500 I NETWORK [conn728] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:53:44.353-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T22:53:48.319-0500 W NETWORK [conn728] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:53:48.319-0500 I NETWORK [conn728] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:53:48.319-0500 I NETWORK [conn728] query on admin.$cmd: { usersInfo: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:53:48.322-0500 I NETWORK [conn728] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:53:49.355-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:53:49.355-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:53:49.355-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T22:53:49.358-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T22:53:49.364-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:53:53.323-0500 W NETWORK [conn728] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:53:53.323-0500 I NETWORK [conn728] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:53:53.323-0500 I NETWORK [conn728] query on admin.$cmd: { usersInfo: [ { user: "dbs_scout2", db: "admin" } ], showPrivileges: true, showCredentials: true } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:53:53.325-0500 I NETWORK [conn728] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T22:53:54.365-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:53:54.366-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:53:54.422-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:53:58.326-0500 W NETWORK [conn728] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:53:58.326-0500 I NETWORK [conn728] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:53:58.326-0500 I NETWORK [conn728] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T22:53:58.328-0500 I NETWORK [conn728] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T22:53:58.334-0500 I NETWORK [conn728] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:53:59.423-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:53:59.424-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:53:59.424-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:53:59.425-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:54:03.336-0500 W NETWORK [conn728] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:54:03.336-0500 I NETWORK [conn728] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:54:03.419-0500 I NETWORK [conn728] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:54:04.427-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:54:04.427-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:54:04.427-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:54:08.420-0500 W NETWORK [conn728] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:54:08.420-0500 I NETWORK [conn728] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:54:08.420-0500 I NETWORK [conn728] query on admin.$cmd: { usersInfo: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:54:08.422-0500 I NETWORK [conn728] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:54:10.596-0500 W NETWORK Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:54:10.596-0500 W SHARDING couldn't check dbhash on config server tconfigdb-m02.db.xxx.com:4307 :: caused by :: 11002 socket exception [CONNECT_ERROR] server [tconfigdb-m02.db.xxx.com:4307] connection pool error: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:54:13.423-0500 W NETWORK [conn728] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:54:13.423-0500 I NETWORK [conn728] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:54:13.423-0500 I NETWORK [conn728] query on admin.$cmd: { usersInfo: [ { user: "dbs_scout2", db: "admin" } ], showPrivileges: true, showCredentials: true } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:54:14.353-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T22:54:19.386-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:54:19.386-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:54:19.386-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T22:54:19.388-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T22:54:19.393-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:54:24.396-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:54:24.396-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:54:24.455-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:54:29.457-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:54:29.457-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:54:29.457-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:54:29.459-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:54:33.275-0500 I NETWORK [conn729] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T22:54:34.461-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:54:34.461-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:54:34.461-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:54:38.278-0500 W NETWORK [conn729] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:54:38.278-0500 I NETWORK [conn729] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:54:38.278-0500 I NETWORK [conn729] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T22:54:38.281-0500 I NETWORK [conn729] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T22:54:38.290-0500 I NETWORK [conn729] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:54:43.292-0500 W NETWORK [conn729] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:54:43.292-0500 I NETWORK [conn729] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:54:43.347-0500 I NETWORK [conn729] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:54:44.353-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T22:54:48.349-0500 W NETWORK [conn729] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:54:48.349-0500 I NETWORK [conn729] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:54:48.349-0500 I NETWORK [conn729] query on admin.$cmd: { usersInfo: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:54:48.353-0500 I NETWORK [conn729] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:54:49.354-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:54:49.355-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:54:49.355-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T22:54:49.357-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T22:54:49.363-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:54:53.355-0500 W NETWORK [conn729] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:54:53.355-0500 I NETWORK [conn729] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:54:53.355-0500 I NETWORK [conn729] query on admin.$cmd: { usersInfo: [ { user: "dbs_scout2", db: "admin" } ], showPrivileges: true, showCredentials: true } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:54:53.357-0500 I NETWORK [conn729] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T22:54:54.364-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:54:54.364-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:54:54.422-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:54:58.358-0500 W NETWORK [conn729] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:54:58.358-0500 I NETWORK [conn729] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:54:58.358-0500 I NETWORK [conn729] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T22:54:58.360-0500 I NETWORK [conn729] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T22:54:58.366-0500 I NETWORK [conn729] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:54:59.424-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:54:59.424-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:54:59.424-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:54:59.426-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:55:03.367-0500 W NETWORK [conn729] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:55:03.367-0500 I NETWORK [conn729] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:55:03.435-0500 I NETWORK [conn729] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:55:04.427-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:55:04.427-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:55:04.427-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:55:08.437-0500 W NETWORK [conn729] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:55:08.437-0500 I NETWORK [conn729] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:55:08.437-0500 I NETWORK [conn729] query on admin.$cmd: { usersInfo: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:55:08.439-0500 I NETWORK [conn729] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:55:13.440-0500 W NETWORK [conn729] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:55:13.440-0500 I NETWORK [conn729] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:55:13.440-0500 I NETWORK [conn729] query on admin.$cmd: { usersInfo: [ { user: "dbs_scout2", db: "admin" } ], showPrivileges: true, showCredentials: true } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:55:14.354-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T22:55:15.609-0500 W NETWORK Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:55:15.609-0500 W SHARDING couldn't check dbhash on config server tconfigdb-m02.db.xxx.com:4307 :: caused by :: 11002 socket exception [CONNECT_ERROR] server [tconfigdb-m02.db.xxx.com:4307] connection pool error: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:55:19.355-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:55:19.356-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:55:19.356-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T22:55:19.358-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T22:55:19.369-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:55:24.370-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:55:24.370-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:55:24.448-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:55:29.449-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:55:29.449-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:55:29.449-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:55:29.451-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:55:34.452-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:55:34.452-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:55:34.452-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:55:44.354-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T22:55:49.415-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:55:49.415-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:55:49.415-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T22:55:49.417-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T22:55:49.424-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:55:54.425-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:55:54.425-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:55:54.489-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:55:59.491-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:55:59.491-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:55:59.491-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:55:59.493-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:56:04.495-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:56:04.495-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:56:04.495-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:56:14.354-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T22:56:19.355-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:56:19.355-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:56:19.355-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T22:56:19.357-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T22:56:19.366-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:56:20.616-0500 W NETWORK Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:56:20.616-0500 W SHARDING couldn't check dbhash on config server tconfigdb-m02.db.xxx.com:4307 :: caused by :: 11002 socket exception [CONNECT_ERROR] server [tconfigdb-m02.db.xxx.com:4307] connection pool error: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:56:24.367-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:56:24.367-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:56:24.427-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:56:29.428-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:56:29.428-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:56:29.428-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:56:29.430-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:56:34.431-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:56:34.431-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:56:34.432-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:56:44.354-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T22:56:49.355-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:56:49.355-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:56:49.355-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T22:56:49.358-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T22:56:49.367-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:56:54.368-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:56:54.368-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:56:54.424-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:56:59.425-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:56:59.425-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:56:59.425-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:56:59.427-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:57:04.473-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:57:04.473-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:57:04.473-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:57:14.353-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T22:57:19.355-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:57:19.355-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:57:19.355-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T22:57:19.358-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T22:57:19.367-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:57:24.368-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:57:24.368-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:57:24.430-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:57:25.711-0500 W NETWORK Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:57:25.711-0500 W SHARDING couldn't check dbhash on config server tconfigdb-m02.db.xxx.com:4307 :: caused by :: 11002 socket exception [CONNECT_ERROR] server [tconfigdb-m02.db.xxx.com:4307] connection pool error: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:57:29.431-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:57:29.432-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:57:29.432-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:57:29.434-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:57:34.435-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:57:34.435-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:57:34.436-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:57:44.354-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T22:57:49.355-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:57:49.355-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:57:49.355-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T22:57:49.457-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T22:57:49.462-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:57:54.464-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:57:54.464-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:57:54.514-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:57:59.516-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:57:59.516-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:57:59.516-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:57:59.518-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:58:04.520-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:58:04.520-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:58:04.520-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:58:14.354-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T22:58:19.355-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:58:19.355-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:58:19.355-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T22:58:19.357-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T22:58:19.366-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:58:24.368-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:58:24.368-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:58:24.425-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:58:29.427-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:58:29.427-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:58:29.427-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:58:29.429-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:58:30.774-0500 W NETWORK Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:58:30.774-0500 W SHARDING couldn't check dbhash on config server tconfigdb-m02.db.xxx.com:4307 :: caused by :: 11002 socket exception [CONNECT_ERROR] server [tconfigdb-m02.db.xxx.com:4307] connection pool error: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:58:34.431-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:58:34.431-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:58:34.431-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:58:44.353-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T22:58:49.355-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:58:49.355-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:58:49.355-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T22:58:49.358-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T22:58:49.366-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:58:54.368-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:58:54.368-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:58:54.446-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:58:59.449-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:58:59.449-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:58:59.449-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:58:59.451-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:59:04.453-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:59:04.453-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:59:04.453-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:59:14.353-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T22:59:19.355-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:59:19.355-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:59:19.355-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T22:59:19.387-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T22:59:19.394-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:59:24.395-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:59:24.395-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:59:24.465-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:59:29.528-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:59:29.528-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:59:29.528-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:59:29.530-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:59:33.141-0500 I NETWORK [conn730] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T22:59:34.531-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:59:34.531-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:59:34.531-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:59:35.782-0500 W NETWORK Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:59:35.782-0500 W SHARDING couldn't check dbhash on config server tconfigdb-m02.db.xxx.com:4307 :: caused by :: 11002 socket exception [CONNECT_ERROR] server [tconfigdb-m02.db.xxx.com:4307] connection pool error: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:59:38.143-0500 W NETWORK [conn730] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:59:38.143-0500 I NETWORK [conn730] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:59:38.143-0500 I NETWORK [conn730] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T22:59:38.145-0500 I NETWORK [conn730] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T22:59:38.152-0500 I NETWORK [conn730] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:59:43.153-0500 W NETWORK [conn730] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:59:43.153-0500 I NETWORK [conn730] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:59:43.223-0500 I NETWORK [conn730] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:59:44.353-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T22:59:48.225-0500 W NETWORK [conn730] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:59:48.225-0500 I NETWORK [conn730] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:59:48.225-0500 I NETWORK [conn730] query on admin.$cmd: { usersInfo: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:59:48.227-0500 I NETWORK [conn730] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:59:49.355-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:59:49.355-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:59:49.355-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T22:59:49.357-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T22:59:49.363-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:59:53.229-0500 W NETWORK [conn730] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:59:53.229-0500 I NETWORK [conn730] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:59:53.230-0500 I NETWORK [conn730] query on admin.$cmd: { usersInfo: [ { user: "dbs_scout2", db: "admin" } ], showPrivileges: true, showCredentials: true } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:59:53.232-0500 I NETWORK [conn730] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T22:59:54.365-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:59:54.365-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:59:54.416-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:59:58.234-0500 W NETWORK [conn730] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:59:58.234-0500 I NETWORK [conn730] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:59:58.234-0500 I NETWORK [conn730] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T22:59:58.236-0500 I NETWORK [conn730] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T22:59:58.242-0500 I NETWORK [conn730] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:59:59.478-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T22:59:59.478-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T22:59:59.479-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T22:59:59.480-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:00:03.243-0500 W NETWORK [conn730] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:00:03.243-0500 I NETWORK [conn730] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:00:03.301-0500 I NETWORK [conn730] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:00:04.481-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:00:04.481-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:00:04.481-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:00:08.303-0500 W NETWORK [conn730] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:00:08.303-0500 I NETWORK [conn730] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:00:08.303-0500 I NETWORK [conn730] query on admin.$cmd: { usersInfo: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:00:08.305-0500 I NETWORK [conn730] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:00:13.307-0500 W NETWORK [conn730] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:00:13.307-0500 I NETWORK [conn730] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:00:13.307-0500 I NETWORK [conn730] query on admin.$cmd: { usersInfo: [ { user: "dbs_scout2", db: "admin" } ], showPrivileges: true, showCredentials: true } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:00:14.353-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:00:19.355-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:00:19.355-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:00:19.355-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:00:19.357-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:00:19.364-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:00:24.365-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:00:24.365-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:00:24.422-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:00:29.424-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:00:29.424-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:00:29.424-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:00:29.426-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:00:34.441-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:00:34.442-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:00:34.442-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:00:40.810-0500 W NETWORK Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:00:40.810-0500 W SHARDING couldn't check dbhash on config server tconfigdb-m02.db.xxx.com:4307 :: caused by :: 11002 socket exception [CONNECT_ERROR] server [tconfigdb-m02.db.xxx.com:4307] connection pool error: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:00:44.354-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:00:49.355-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:00:49.355-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:00:49.355-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:00:49.459-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:00:49.466-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:00:54.467-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:00:54.467-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:00:54.534-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:00:59.535-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:00:59.535-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:00:59.535-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:00:59.537-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:01:04.540-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:01:04.540-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:01:04.541-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:01:14.354-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:01:19.355-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:01:19.355-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:01:19.355-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:01:19.357-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:01:19.366-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:01:24.368-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:01:24.368-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:01:24.429-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:01:29.431-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:01:29.431-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:01:29.431-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:01:29.459-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:01:34.461-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:01:34.461-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:01:34.461-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:01:44.354-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:01:45.996-0500 W NETWORK Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:01:45.997-0500 W SHARDING couldn't check dbhash on config server tconfigdb-m02.db.xxx.com:4307 :: caused by :: 11002 socket exception [CONNECT_ERROR] server [tconfigdb-m02.db.xxx.com:4307] connection pool error: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:01:49.356-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:01:49.356-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:01:49.356-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:01:49.358-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:01:49.365-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:01:54.366-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:01:54.366-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:01:54.425-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:01:59.426-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:01:59.426-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:01:59.426-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:01:59.428-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:02:04.430-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:02:04.430-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:02:04.430-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:02:14.355-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:02:19.356-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:02:19.356-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:02:19.357-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:02:19.358-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:02:19.365-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:02:24.367-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:02:24.367-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:02:24.419-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:02:29.421-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:02:29.421-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:02:29.421-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:02:29.423-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:02:34.424-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:02:34.424-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:02:34.424-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:02:44.354-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:02:49.355-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:02:49.356-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:02:49.356-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:02:49.358-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:02:49.366-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:02:51.004-0500 W NETWORK Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:02:51.004-0500 W SHARDING couldn't check dbhash on config server tconfigdb-m02.db.xxx.com:4307 :: caused by :: 11002 socket exception [CONNECT_ERROR] server [tconfigdb-m02.db.xxx.com:4307] connection pool error: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:02:54.368-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:02:54.368-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:02:54.428-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:02:59.502-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:02:59.502-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:02:59.502-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:02:59.503-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:03:04.581-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:03:04.582-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:03:04.582-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:03:14.354-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:03:19.356-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:03:19.356-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:03:19.356-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:03:19.359-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:03:19.365-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:03:24.367-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:03:24.367-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:03:24.431-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:03:29.432-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:03:29.432-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:03:29.432-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:03:29.434-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:03:34.435-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:03:34.435-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:03:34.435-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:03:44.354-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:03:49.358-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:03:49.358-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:03:49.358-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:03:49.363-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:03:49.383-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:03:54.385-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:03:54.385-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:03:54.447-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:03:56.013-0500 W NETWORK Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:03:56.013-0500 W SHARDING couldn't check dbhash on config server tconfigdb-m02.db.xxx.com:4307 :: caused by :: 11002 socket exception [CONNECT_ERROR] server [tconfigdb-m02.db.xxx.com:4307] connection pool error: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:03:59.448-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:03:59.448-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:03:59.448-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:03:59.451-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:04:04.452-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:04:04.452-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:04:04.453-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:04:14.355-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:04:19.357-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:04:19.357-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:04:19.357-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:04:19.359-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:04:19.367-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:04:24.368-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:04:24.368-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:04:24.428-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:04:29.430-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:04:29.430-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:04:29.430-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:04:29.432-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:04:33.257-0500 I NETWORK [conn731] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:04:34.434-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:04:34.434-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:04:34.435-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:04:38.259-0500 W NETWORK [conn731] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:04:38.259-0500 I NETWORK [conn731] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:04:38.259-0500 I NETWORK [conn731] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:04:38.261-0500 I NETWORK [conn731] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:04:38.267-0500 I NETWORK [conn731] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:04:43.269-0500 W NETWORK [conn731] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:04:43.269-0500 I NETWORK [conn731] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:04:43.329-0500 I NETWORK [conn731] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:04:44.354-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:04:48.331-0500 W NETWORK [conn731] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:04:48.331-0500 I NETWORK [conn731] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:04:48.331-0500 I NETWORK [conn731] query on admin.$cmd: { usersInfo: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:04:48.441-0500 I NETWORK [conn731] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:04:49.359-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:04:49.360-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:04:49.360-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:04:49.362-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:04:49.369-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:04:53.443-0500 W NETWORK [conn731] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:04:53.443-0500 I NETWORK [conn731] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:04:53.443-0500 I NETWORK [conn731] query on admin.$cmd: { usersInfo: [ { user: "dbs_scout2", db: "admin" } ], showPrivileges: true, showCredentials: true } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:04:53.445-0500 I NETWORK [conn731] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:04:54.371-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:04:54.371-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:04:54.440-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:04:58.446-0500 W NETWORK [conn731] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:04:58.446-0500 I NETWORK [conn731] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:04:58.446-0500 I NETWORK [conn731] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:04:58.450-0500 I NETWORK [conn731] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:04:58.456-0500 I NETWORK [conn731] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:04:59.442-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:04:59.442-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:04:59.442-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:04:59.444-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:05:01.020-0500 W NETWORK Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:05:01.020-0500 W SHARDING couldn't check dbhash on config server tconfigdb-m02.db.xxx.com:4307 :: caused by :: 11002 socket exception [CONNECT_ERROR] server [tconfigdb-m02.db.xxx.com:4307] connection pool error: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:05:03.458-0500 W NETWORK [conn731] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:05:03.458-0500 I NETWORK [conn731] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:05:03.515-0500 I NETWORK [conn731] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:05:04.445-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:05:04.445-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:05:04.445-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:05:08.517-0500 W NETWORK [conn731] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:05:08.517-0500 I NETWORK [conn731] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:05:08.517-0500 I NETWORK [conn731] query on admin.$cmd: { usersInfo: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:05:08.519-0500 I NETWORK [conn731] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:05:08.737-0500 I NETWORK [Balancer] Socket recv() errno:110 Connection timed out 10.74.137.2:4307 2017-02-02T23:05:08.737-0500 I NETWORK [Balancer] SocketException: remote: 10.74.137.2:4307 error: 9001 socket exception [RECV_ERROR] server [10.74.137.2:4307] 2017-02-02T23:05:08.737-0500 I NETWORK [Balancer] Detected bad connection created at 1485887214257219 microSec, clearing pool for tconfigdb-m02.db.xxx.com:4307 of 0 connections 2017-02-02T23:05:08.738-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:05:13.520-0500 W NETWORK [conn731] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:05:13.520-0500 I NETWORK [conn731] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:05:13.520-0500 I NETWORK [conn731] query on admin.$cmd: { usersInfo: [ { user: "dbs_scout2", db: "admin" } ], showPrivileges: true, showCredentials: true } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:05:13.739-0500 W NETWORK [Balancer] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:05:13.739-0500 I NETWORK [Balancer] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:05:13.739-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:05:13.744-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:05:13.751-0500 I NETWORK [Balancer] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:05:14.354-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:05:18.752-0500 W NETWORK [Balancer] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:05:18.753-0500 I NETWORK [Balancer] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:05:18.811-0500 I NETWORK [Balancer] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:05:19.355-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:05:19.355-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:05:19.355-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:05:19.357-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:05:19.364-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:05:23.813-0500 W NETWORK [Balancer] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:05:23.813-0500 I NETWORK [Balancer] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:05:23.813-0500 I NETWORK [Balancer] query on config.shards: {} failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:05:23.814-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:05:24.366-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:05:24.366-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:05:24.428-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:05:28.815-0500 W NETWORK [Balancer] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:05:28.815-0500 I NETWORK [Balancer] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:05:28.815-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:05:28.819-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:05:28.825-0500 I NETWORK [Balancer] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:05:29.430-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:05:29.430-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:05:29.430-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:05:29.432-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:05:33.827-0500 W NETWORK [Balancer] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:05:33.827-0500 I NETWORK [Balancer] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:05:33.883-0500 I NETWORK [Balancer] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:05:34.553-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:05:34.553-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:05:34.553-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:05:38.884-0500 W NETWORK [Balancer] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:05:38.884-0500 I NETWORK [Balancer] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:05:38.884-0500 I NETWORK [Balancer] query on config.settings: { _id: "chunksize" } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:05:38.885-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:05:43.902-0500 W NETWORK [Balancer] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:05:43.902-0500 I NETWORK [Balancer] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:05:43.902-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:05:43.991-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:05:44.000-0500 I NETWORK [Balancer] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:05:44.355-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:05:49.001-0500 W NETWORK [Balancer] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:05:49.001-0500 I NETWORK [Balancer] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:05:49.060-0500 I NETWORK [Balancer] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:05:49.356-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:05:49.356-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:05:49.356-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:05:49.450-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:05:49.456-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:05:54.062-0500 W NETWORK [Balancer] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:05:54.062-0500 I NETWORK [Balancer] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:05:54.062-0500 I NETWORK [Balancer] query on config.settings: { _id: "balancer" } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:05:54.457-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:05:54.457-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:05:54.514-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:05:59.064-0500 W NETWORK [Balancer] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:05:59.516-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:05:59.516-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:05:59.516-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: "1", help: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:05:59.518-0500 I NETWORK [UserCacheInvalidator] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:06:04.521-0500 W NETWORK [UserCacheInvalidator] Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:06:04.521-0500 I NETWORK [UserCacheInvalidator] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:06:04.521-0500 I NETWORK [UserCacheInvalidator] query on admin.$cmd: { _getUserCacheGeneration: 1 } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:06:06.087-0500 W NETWORK Failed to connect to 10.74.137.2:4307 after 5000 milliseconds, giving up. 2017-02-02T23:06:06.087-0500 W SHARDING couldn't check dbhash on config server tconfigdb-m02.db.xxx.com:4307 :: caused by :: 11002 socket exception [CONNECT_ERROR] server [tconfigdb-m02.db.xxx.com:4307] connection pool error: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:06:09.067-0500 W NETWORK [Balancer] Socket recv() failed during connectivity check (idle 992 secs, remote host 10.74.137.2:4307) :: caused by :: errno:110 Connection timed out 2017-02-02T23:06:09.068-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:06:09.071-0500 W NETWORK [Balancer] Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-02-02T23:06:09.071-0500 I NETWORK [Balancer] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:06:09.071-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:06:09.074-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:06:09.079-0500 I NETWORK [Balancer] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:06:09.083-0500 W NETWORK [Balancer] Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-02-02T23:06:09.083-0500 I NETWORK [Balancer] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:06:09.137-0500 W NETWORK [Balancer] Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-02-02T23:06:09.140-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:06:09.143-0500 W NETWORK [Balancer] Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-02-02T23:06:09.143-0500 I NETWORK [Balancer] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:06:09.143-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:06:09.144-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:06:09.150-0500 I NETWORK [Balancer] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:06:09.154-0500 W NETWORK [Balancer] Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-02-02T23:06:09.154-0500 I NETWORK [Balancer] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:06:09.212-0500 I NETWORK [Balancer] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:06:09.216-0500 W NETWORK [Balancer] Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-02-02T23:06:09.216-0500 I NETWORK [Balancer] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:06:09.216-0500 I NETWORK [Balancer] query on config.shards: {} failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:06:09.217-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:06:09.221-0500 W NETWORK [Balancer] Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-02-02T23:06:09.221-0500 I NETWORK [Balancer] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:06:09.221-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:06:09.223-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:06:09.230-0500 I NETWORK [Balancer] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:06:09.233-0500 W NETWORK [Balancer] Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-02-02T23:06:09.233-0500 I NETWORK [Balancer] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:06:09.287-0500 I NETWORK [Balancer] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:06:09.292-0500 W NETWORK [Balancer] Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-02-02T23:06:09.292-0500 I NETWORK [Balancer] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:06:09.292-0500 I NETWORK [Balancer] query on config.settings: { _id: "chunksize" } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:06:09.292-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:06:09.297-0500 W NETWORK [Balancer] Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-02-02T23:06:09.297-0500 I NETWORK [Balancer] SyncClusterConnection connect fail to: tconfigdb-m02.db.xxx.com:4307 errmsg: couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:06:09.297-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:06:09.299-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:06:09.305-0500 I NETWORK [Balancer] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:06:09.309-0500 W NETWORK [Balancer] Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-02-02T23:06:09.309-0500 I NETWORK [Balancer] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:06:09.373-0500 I NETWORK [Balancer] trying reconnect to tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:06:09.378-0500 W NETWORK [Balancer] Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-02-02T23:06:09.378-0500 I NETWORK [Balancer] reconnect tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed failed couldn't connect to server tconfigdb-m02.db.xxx.com:4307 (10.74.137.2), connection attempt failed 2017-02-02T23:06:09.378-0500 I NETWORK [Balancer] query on config.settings: { _id: "balancer" } failed to: tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed exception: socket exception [CONNECT_ERROR] for tconfigdb-m02.db.xxx.com:4307 (10.74.137.2) failed 2017-02-02T23:06:09.384-0500 W NETWORK [Balancer] Failed to connect to 10.74.137.2:4307, reason: errno:111 Connection refused 2017-02-02T23:06:14.355-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:06:14.359-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:06:14.361-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:06:14.448-0500 I ACCESS [UserCacheInvalidator] User cache generation changed from 5890d689cd3809e9cc360506 to 589401b377c4818a6415d201; invalidating user cache 2017-02-02T23:06:19.436-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:06:19.441-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:06:19.442-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:41:36.715-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:41:36.715-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:41:45.245-0500 W NETWORK [conn725] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-02T23:41:45.294-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-02T23:41:45.311-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-02T23:41:46.919-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:41:46.924-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:41:46.926-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:41:47.021-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:41:47.022-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:41:56.660-0500 W NETWORK [conn725] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-02T23:41:56.668-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-02T23:41:56.676-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-02T23:41:57.069-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:41:57.073-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:41:57.075-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:41:57.173-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:41:57.173-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:41:59.543-0500 W NETWORK [conn725] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-02T23:41:59.547-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-02T23:41:59.551-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-02T23:42:07.211-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:42:07.216-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:42:07.218-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:42:07.321-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:42:07.321-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:42:17.361-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:42:17.365-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:42:17.367-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:42:17.464-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:42:17.464-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:42:22.533-0500 W NETWORK [conn725] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-02T23:42:22.539-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-02T23:42:22.544-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-02T23:42:27.562-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:42:27.566-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:42:27.569-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:42:27.677-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:42:27.677-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:42:37.706-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:42:37.710-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:42:37.712-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:42:37.803-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:42:37.803-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:42:47.836-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:42:47.839-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:42:47.841-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:42:47.988-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:42:47.989-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:42:58.018-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:42:58.021-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:42:58.023-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:42:58.116-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:42:58.116-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:43:02.758-0500 W NETWORK [conn725] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-02T23:43:02.761-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-02T23:43:02.765-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-02T23:43:08.147-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:43:08.151-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:43:08.153-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:43:08.262-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:43:08.262-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:43:11.424-0500 W NETWORK [conn725] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-02T23:43:11.430-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-02T23:43:11.436-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-02T23:43:12.070-0500 W NETWORK [conn725] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-02T23:43:12.076-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-02T23:43:12.084-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-02T23:43:18.296-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:43:18.311-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:43:18.317-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:43:18.412-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:43:18.412-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:43:18.629-0500 W NETWORK [conn725] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-02T23:43:18.633-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-02T23:43:18.637-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-02T23:43:28.449-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:43:28.453-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:43:28.456-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:43:28.551-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:43:28.552-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:43:38.588-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:43:38.592-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:43:38.593-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:43:38.699-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:43:38.699-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:43:48.728-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:43:48.734-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:43:48.736-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:43:48.839-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:43:48.839-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:43:58.875-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:43:58.878-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:43:58.879-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:43:58.966-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:43:58.966-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:44:09.002-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:44:09.006-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:44:09.009-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:44:09.112-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:44:09.112-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:44:13.468-0500 W NETWORK [conn725] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-02T23:44:13.471-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-02T23:44:13.475-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-02T23:44:19.197-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:44:19.201-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:44:19.203-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:44:19.292-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:44:19.292-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:44:29.344-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:44:29.348-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:44:29.350-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:44:29.356-0500 I NETWORK [conn725] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:44:29.360-0500 I NETWORK [conn725] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:44:29.362-0500 I NETWORK [conn725] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:44:29.437-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:44:29.437-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:44:29.464-0500 W NETWORK [conn725] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-02T23:44:29.468-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-02T23:44:29.474-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-02T23:44:39.472-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:44:39.472-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:44:49.521-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:44:49.525-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:44:49.528-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:44:49.640-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:44:49.640-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:44:59.672-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:44:59.676-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:44:59.677-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:44:59.765-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:44:59.766-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:45:01.311-0500 W NETWORK [conn725] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-02T23:45:01.315-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-02T23:45:01.319-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-02T23:45:09.797-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:45:09.801-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:45:09.853-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:45:09.964-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:45:09.964-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:45:20.091-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:45:20.095-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:45:20.097-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:45:20.188-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:45:20.188-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:45:29.374-0500 W NETWORK [conn725] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-02T23:45:29.379-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-02T23:45:29.383-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-02T23:45:30.350-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:45:30.385-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:45:30.462-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:45:30.598-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:45:30.598-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:45:40.634-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:45:40.638-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:45:40.640-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:45:40.732-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:45:40.732-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:45:42.162-0500 W NETWORK [conn725] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-02T23:45:42.169-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-02T23:45:42.177-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-02T23:45:50.757-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:45:50.761-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:45:50.763-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:45:50.865-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:45:50.865-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:46:00.895-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:46:00.899-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:46:00.901-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:46:00.998-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:46:00.999-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:46:11.035-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:46:11.040-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:46:11.043-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:46:11.139-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:46:11.139-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:46:18.486-0500 W NETWORK [conn725] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-02T23:46:18.489-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-02T23:46:18.493-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-02T23:46:21.169-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:46:21.172-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:46:21.174-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:46:21.263-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:46:21.263-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:46:31.094-0500 W NETWORK [conn725] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-02T23:46:31.102-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-02T23:46:31.109-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-02T23:46:31.490-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:46:31.494-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:46:31.496-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:46:31.595-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:46:31.596-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:46:41.626-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:46:41.630-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:46:41.632-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:46:41.754-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:46:41.755-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:46:41.824-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-02T23:46:41.827-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-02T23:46:41.832-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-02T23:46:51.792-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:46:51.796-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:46:51.798-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:46:51.910-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:46:51.910-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:47:01.947-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:47:01.950-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:47:01.952-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:47:02.046-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:47:02.046-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:47:08.678-0500 W NETWORK [conn725] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-02T23:47:08.681-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-02T23:47:08.686-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-02T23:47:08.755-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-02T23:47:08.759-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-02T23:47:08.765-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-02T23:47:12.077-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:47:12.081-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:47:12.083-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:47:12.201-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:47:12.201-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:47:13.861-0500 W NETWORK [conn725] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-02T23:47:13.864-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-02T23:47:13.869-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-02T23:47:22.239-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:47:22.243-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:47:22.246-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:47:22.337-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:47:22.337-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:47:32.376-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:47:32.380-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:47:32.382-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:47:32.487-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:47:32.488-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:47:42.527-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:47:42.532-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:47:42.535-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:47:42.630-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:47:42.630-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:47:52.668-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:47:52.672-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:47:52.674-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:47:52.773-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:47:52.773-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:48:02.810-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:48:02.814-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:48:02.815-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:48:02.910-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:48:02.911-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:48:03.521-0500 W NETWORK [conn725] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-02T23:48:03.526-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-02T23:48:03.535-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-02T23:48:12.936-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:48:12.940-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:48:12.942-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:48:13.055-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:48:13.055-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:48:16.770-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-02T23:48:16.778-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-02T23:48:16.788-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-02T23:48:23.098-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:48:23.101-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:48:23.104-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:48:23.227-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:48:23.228-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:48:33.285-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:48:33.290-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:48:33.292-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:48:33.383-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:48:33.384-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:48:43.436-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:48:43.440-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:48:43.441-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:48:43.521-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:48:43.521-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:48:53.541-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:48:53.545-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:48:53.547-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:48:53.631-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:48:53.632-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:49:03.700-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:49:03.704-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:49:03.707-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:49:03.818-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:49:03.818-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:49:04.003-0500 W NETWORK [conn725] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-02T23:49:04.007-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-02T23:49:04.011-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-02T23:49:08.446-0500 W NETWORK [conn725] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-02T23:49:08.450-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-02T23:49:08.456-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-02T23:49:13.854-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:49:13.858-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:49:13.860-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:49:13.965-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:49:13.965-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:49:24.082-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:49:24.086-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:49:24.088-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:49:24.179-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:49:24.179-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:49:34.213-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:49:34.217-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:49:34.219-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:49:34.308-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:49:34.308-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:49:40.888-0500 W NETWORK [conn725] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-02T23:49:40.892-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-02T23:49:40.897-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-02T23:49:44.345-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:49:44.350-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:49:44.353-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:49:44.380-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:49:44.384-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:49:44.385-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:49:44.449-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:49:44.450-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:49:54.487-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:49:54.487-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:50:04.518-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:50:04.522-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:50:04.524-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:50:04.612-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:50:04.612-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:50:14.644-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:50:14.648-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:50:14.650-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:50:14.746-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:50:14.746-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:50:24.783-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:50:24.787-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:50:24.789-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:50:24.902-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:50:24.902-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:50:35.044-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:50:35.049-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:50:35.051-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:50:35.155-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:50:35.155-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:50:45.194-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:50:45.199-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:50:45.200-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:50:45.310-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:50:45.311-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:50:55.369-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:50:55.372-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:50:55.374-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:50:55.474-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:50:55.474-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:51:05.520-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:51:05.525-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:51:05.527-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:51:05.636-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:51:05.636-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:51:15.671-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:51:15.675-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:51:15.677-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:51:15.768-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:51:15.768-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:51:25.819-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:51:25.823-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:51:25.825-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:51:25.913-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:51:25.913-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:51:35.944-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:51:35.948-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:51:35.950-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:51:36.045-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:51:36.045-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:51:46.089-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:51:46.093-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:51:46.096-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:51:46.203-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:51:46.203-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:51:56.234-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:51:56.238-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:51:56.241-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:51:56.345-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:51:56.345-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:51:59.431-0500 W NETWORK [conn725] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-02T23:51:59.435-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-02T23:51:59.439-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-02T23:52:06.382-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:52:06.400-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:52:06.402-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:52:06.488-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:52:06.489-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:52:08.810-0500 W NETWORK [conn725] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-02T23:52:08.815-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-02T23:52:08.819-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-02T23:52:14.233-0500 W NETWORK [conn725] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-02T23:52:14.240-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-02T23:52:14.245-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-02T23:52:16.520-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:52:16.525-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:52:16.527-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:52:16.624-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:52:16.624-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:52:26.664-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:52:26.667-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:52:26.669-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:52:26.763-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:52:26.763-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:52:36.799-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:52:36.803-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:52:36.805-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:52:37.119-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:52:37.119-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:52:41.419-0500 W NETWORK [conn725] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-02T23:52:41.426-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-02T23:52:41.432-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-02T23:52:47.161-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:52:47.165-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:52:47.167-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:52:47.253-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:52:47.254-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:52:57.283-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:52:57.288-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:52:57.291-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:52:57.376-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:52:57.376-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:53:02.037-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-02T23:53:02.042-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-02T23:53:02.050-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-02T23:53:05.029-0500 W NETWORK [conn725] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-02T23:53:05.033-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-02T23:53:05.037-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-02T23:53:07.405-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:53:07.409-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:53:07.411-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:53:07.491-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:53:07.491-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:53:17.523-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:53:17.527-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:53:17.529-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:53:17.629-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:53:17.629-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:53:18.044-0500 W NETWORK [conn725] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-02T23:53:18.047-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-02T23:53:18.051-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-02T23:53:22.930-0500 W NETWORK [conn725] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-02T23:53:22.936-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-02T23:53:22.940-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-02T23:53:27.672-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:53:27.676-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:53:27.680-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:53:27.780-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:53:27.780-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:53:37.816-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:53:37.820-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:53:37.821-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:53:37.928-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:53:37.928-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:53:47.968-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:53:47.972-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:53:47.979-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:53:48.066-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:53:48.066-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:53:58.108-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:53:58.111-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:53:58.113-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:53:58.205-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:53:58.205-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:54:08.235-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:54:08.239-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:54:08.242-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:54:08.336-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:54:08.337-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:54:18.376-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:54:18.380-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:54:18.382-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:54:18.475-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:54:18.475-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:54:28.506-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:54:28.510-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:54:28.512-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:54:28.599-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:54:28.599-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:54:38.630-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:54:38.634-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:54:38.636-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:54:38.738-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:54:38.738-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:54:48.773-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:54:48.777-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:54:48.779-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:54:48.877-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:54:48.878-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:54:58.909-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:54:58.913-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:54:58.984-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:54:59.076-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:54:59.077-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:55:09.115-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:55:09.121-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:55:09.123-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:55:09.232-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:55:09.232-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:55:19.271-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:55:19.275-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:55:19.276-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:55:19.379-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:55:19.379-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:55:29.409-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:55:29.413-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:55:29.416-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:55:29.506-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:55:29.507-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:55:39.537-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:55:39.540-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:55:39.543-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:55:39.647-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:55:39.647-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:55:40.027-0500 W NETWORK [conn725] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-02T23:55:40.032-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-02T23:55:40.036-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-02T23:55:41.971-0500 W NETWORK [conn725] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-02T23:55:41.978-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-02T23:55:41.988-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-02T23:55:49.505-0500 W NETWORK [conn725] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-02T23:55:49.510-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-02T23:55:49.514-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-02T23:55:49.683-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:55:49.686-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:55:49.689-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:55:49.775-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:55:49.775-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:55:59.812-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:55:59.816-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:55:59.818-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:55:59.914-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:55:59.914-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:56:09.962-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:56:09.967-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:56:09.968-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:56:10.070-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:56:10.071-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:56:16.156-0500 W NETWORK [conn725] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-02T23:56:16.163-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-02T23:56:16.168-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-02T23:56:20.108-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:56:20.112-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:56:20.115-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:56:20.208-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:56:20.209-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:56:30.246-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:56:30.250-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:56:30.252-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:56:30.351-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:56:30.351-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:56:39.083-0500 W NETWORK [conn725] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-02T23:56:39.087-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-02T23:56:39.092-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-02T23:56:40.386-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:56:40.391-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:56:40.392-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:56:40.484-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:56:40.484-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:56:50.548-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:56:50.552-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:56:50.554-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:56:50.650-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:56:50.650-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:57:00.685-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:57:00.691-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:57:00.694-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:57:00.786-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:57:00.787-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:57:10.818-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:57:10.821-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:57:10.872-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:57:10.956-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:57:10.956-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:57:15.929-0500 W NETWORK [conn725] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-02T23:57:15.935-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-02T23:57:15.939-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-02T23:57:16.004-0500 W NETWORK [conn725] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-02T23:57:16.010-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-02T23:57:16.019-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-02T23:57:20.986-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:57:20.991-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:57:20.992-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:57:21.097-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:57:21.098-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:57:31.133-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:57:31.137-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:57:31.140-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:57:31.239-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:57:31.239-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:57:41.275-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:57:41.280-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:57:41.282-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:57:41.376-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:57:41.376-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:57:51.415-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:57:51.458-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:57:51.553-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:57:51.675-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:57:51.675-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:58:01.704-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:58:01.720-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:58:01.722-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:58:01.816-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:58:01.816-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:58:11.849-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:58:11.853-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:58:11.855-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:58:11.944-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:58:11.944-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:58:21.976-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:58:21.980-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:58:21.982-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:58:22.073-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:58:22.073-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:58:32.106-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:58:32.110-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:58:32.113-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:58:32.212-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:58:32.212-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:58:36.775-0500 W NETWORK [conn725] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-02T23:58:36.779-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-02T23:58:36.785-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-02T23:58:40.884-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-02T23:58:40.890-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-02T23:58:40.899-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-02T23:58:42.295-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:58:42.299-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:58:42.303-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:58:42.391-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:58:42.391-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:58:49.576-0500 W NETWORK [conn725] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-02T23:58:49.580-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-02T23:58:49.585-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-02T23:58:52.427-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:58:52.433-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:58:52.435-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:58:52.537-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:58:52.537-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:59:02.571-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:59:02.576-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:59:02.578-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:59:02.670-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:59:02.670-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:59:11.261-0500 W NETWORK [conn725] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-02T23:59:11.266-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-02T23:59:11.271-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-02T23:59:12.706-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:59:12.710-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:59:12.711-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:59:12.796-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:59:12.797-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:59:22.976-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:59:22.983-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:59:22.987-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:59:23.086-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:59:23.086-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:59:33.130-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:59:33.134-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:59:33.136-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:59:33.241-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:59:33.241-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:59:43.272-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:59:43.276-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:59:43.279-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:59:43.392-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:59:43.392-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-02T23:59:53.426-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-02T23:59:53.430-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-02T23:59:53.432-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-02T23:59:53.538-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-02T23:59:53.538-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:00:03.587-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:00:03.590-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:00:03.592-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:00:03.676-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:00:03.676-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:00:06.358-0500 W NETWORK [conn725] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:00:06.364-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:00:06.368-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:00:06.715-0500 W NETWORK [conn725] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:00:06.720-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:00:06.724-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:00:11.095-0500 W NETWORK [conn725] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:00:11.105-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:00:11.110-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:00:13.920-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:00:13.923-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:00:13.925-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:00:14.018-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:00:14.018-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:00:24.052-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:00:24.055-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:00:24.057-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:00:24.167-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:00:24.168-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:00:33.976-0500 W NETWORK [conn725] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:00:33.981-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:00:33.986-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:00:34.196-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:00:34.200-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:00:34.202-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:00:34.293-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:00:34.293-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:00:44.343-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:00:44.347-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:00:44.349-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:00:44.384-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:00:44.387-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:00:44.389-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:00:44.435-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:00:44.435-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:00:49.654-0500 W NETWORK [conn725] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:00:49.659-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:00:49.663-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:00:54.476-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:00:54.476-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:01:04.508-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:01:04.512-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:01:04.514-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:01:04.601-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:01:04.601-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:01:11.162-0500 W NETWORK [conn725] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:01:11.165-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:01:11.169-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:01:14.628-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:01:14.631-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:01:14.633-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:01:14.724-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:01:14.724-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:01:24.784-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:01:24.788-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:01:24.789-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:01:24.870-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:01:24.870-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:01:34.903-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:01:34.906-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:01:34.908-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:01:35.000-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:01:35.000-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:01:45.037-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:01:45.040-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:01:45.042-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:01:45.133-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:01:45.133-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:01:55.163-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:01:55.167-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:01:55.169-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:01:55.265-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:01:55.265-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:01:56.566-0500 W NETWORK [conn725] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:01:56.573-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:01:56.577-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:02:05.297-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:02:05.301-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:02:05.303-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:02:05.389-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:02:05.389-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:02:15.419-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:02:15.422-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:02:15.425-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:02:15.528-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:02:15.529-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:02:21.734-0500 W NETWORK [conn725] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:02:21.737-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:02:21.742-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:02:25.562-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:02:25.566-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:02:25.569-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:02:25.661-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:02:25.662-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:02:30.492-0500 W NETWORK [conn725] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:02:30.498-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:02:30.502-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:02:35.702-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:02:35.706-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:02:35.708-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:02:35.807-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:02:35.807-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:02:45.874-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:02:45.878-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:02:45.880-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:02:45.975-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:02:45.975-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:02:56.009-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:02:56.013-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:02:56.015-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:02:56.103-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:02:56.103-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:03:01.563-0500 W NETWORK [conn725] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:03:01.631-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:03:01.637-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:03:06.132-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:03:06.135-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:03:06.137-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:03:06.229-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:03:06.229-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:03:16.262-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:03:16.267-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:03:16.269-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:03:16.304-0500 I NETWORK [conn725] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:03:16.308-0500 I NETWORK [conn725] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:03:16.311-0500 I NETWORK [conn725] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:03:16.380-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:03:16.380-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:03:16.403-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:03:16.407-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:03:16.413-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:03:26.417-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:03:26.417-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:03:35.685-0500 W NETWORK [conn725] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:03:35.688-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:03:35.693-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:03:35.965-0500 W NETWORK [conn725] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:03:35.969-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:03:35.974-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:03:36.512-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:03:36.517-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:03:36.519-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:03:36.623-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:03:36.623-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:03:39.384-0500 W NETWORK [conn725] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:03:39.389-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:03:39.395-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:03:46.693-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:03:46.697-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:03:46.699-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:03:46.793-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:03:46.793-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:03:56.831-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:03:56.835-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:03:56.837-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:03:56.948-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:03:56.948-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:03:58.467-0500 W NETWORK [conn725] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:03:58.470-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:03:58.475-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:04:06.982-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:04:06.986-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:04:06.989-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:04:07.079-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:04:07.080-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:04:17.111-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:04:17.114-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:04:17.116-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:04:17.199-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:04:17.199-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:04:27.232-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:04:27.236-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:04:27.238-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:04:27.326-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:04:27.326-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:04:37.356-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:04:37.360-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:04:37.362-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:04:37.442-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:04:37.442-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:04:44.966-0500 W NETWORK [conn725] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:04:44.969-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:04:44.973-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:04:47.476-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:04:47.479-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:04:47.481-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:04:47.584-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:04:47.584-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:04:56.305-0500 W NETWORK [conn725] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:04:56.312-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:04:56.317-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:04:57.613-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:04:57.616-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:04:57.617-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:04:57.695-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:04:57.695-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:05:07.727-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:05:07.731-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:05:07.733-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:05:07.834-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:05:07.834-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:05:15.947-0500 W NETWORK [conn725] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:05:15.953-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:05:15.957-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:05:17.894-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:05:17.898-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:05:17.900-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:05:17.986-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:05:17.986-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:05:28.038-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:05:28.041-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:05:28.043-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:05:28.134-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:05:28.134-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:05:38.190-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:05:38.194-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:05:38.197-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:05:38.314-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:05:38.315-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:05:43.362-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:05:43.366-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:05:43.370-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:05:48.349-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:05:48.354-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:05:48.356-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:05:48.446-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:05:48.446-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:05:58.488-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:05:58.492-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:05:58.494-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:05:58.590-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:05:58.590-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:05:58.820-0500 W NETWORK [conn725] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:05:58.824-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:05:58.829-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:06:08.742-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:06:08.746-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:06:08.747-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:06:08.841-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:06:08.841-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:06:15.938-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:06:15.942-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:06:15.946-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:06:18.859-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:06:18.862-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:06:18.864-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:06:18.955-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:06:18.955-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:06:28.976-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:06:28.981-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:06:28.983-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:06:29.099-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:06:29.099-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:06:39.217-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:06:39.222-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:06:39.225-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:06:39.315-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:06:39.315-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:06:45.634-0500 W NETWORK [conn725] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:06:45.642-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:06:45.646-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:06:47.573-0500 I NETWORK [conn738] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:06:47.575-0500 W NETWORK [conn725] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:06:47.578-0500 I NETWORK [conn738] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:06:47.580-0500 I NETWORK [conn738] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:06:47.582-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:06:47.586-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:06:47.669-0500 W NETWORK [conn738] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:06:47.672-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:06:47.677-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:06:49.348-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:06:49.349-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:06:56.627-0500 W NETWORK [conn738] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:06:56.630-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:06:56.634-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:06:59.389-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:06:59.392-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:06:59.394-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:06:59.490-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:06:59.490-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:07:08.377-0500 W NETWORK [conn738] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:07:08.381-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:07:08.385-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:07:09.524-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:07:09.528-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:07:09.575-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:07:09.681-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:07:09.681-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:07:10.431-0500 W NETWORK [conn738] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:07:10.435-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:07:10.439-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:07:19.717-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:07:19.720-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:07:19.722-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:07:19.817-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:07:19.817-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:07:22.916-0500 W NETWORK [conn738] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:07:22.921-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:07:22.926-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:07:29.850-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:07:29.855-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:07:29.859-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:07:29.959-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:07:29.959-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:07:33.231-0500 W NETWORK [conn738] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:07:33.237-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:07:33.241-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:07:34.397-0500 W NETWORK [conn738] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:07:34.402-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:07:34.414-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:07:34.951-0500 W NETWORK [conn738] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:07:34.954-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:07:34.958-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:07:39.983-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:07:39.987-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:07:39.990-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:07:40.079-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:07:40.079-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:07:50.110-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:07:50.115-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:07:50.117-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:07:50.229-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:07:50.230-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:08:00.263-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:08:00.267-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:08:00.270-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:08:00.396-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:08:00.396-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:08:02.717-0500 W NETWORK [conn738] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:08:02.721-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:08:02.727-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:08:10.432-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:08:10.435-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:08:10.437-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:08:10.527-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:08:10.527-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:08:20.559-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:08:20.563-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:08:20.565-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:08:20.656-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:08:20.656-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:08:30.686-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:08:30.689-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:08:30.691-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:08:30.782-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:08:30.782-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:08:40.821-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:08:40.825-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:08:40.828-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:08:40.924-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:08:40.925-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:08:50.955-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:08:50.961-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:08:50.963-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:08:51.068-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:08:51.068-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:08:59.409-0500 W NETWORK [conn738] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:08:59.413-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:08:59.417-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:09:01.100-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:09:01.104-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:09:01.106-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:09:01.205-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:09:01.205-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:09:07.198-0500 W NETWORK [conn738] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:09:07.202-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:09:07.207-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:09:09.347-0500 W NETWORK [conn738] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:09:09.351-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:09:09.355-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:09:10.805-0500 W NETWORK [conn738] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:09:10.812-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:09:10.816-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:09:11.239-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:09:11.244-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:09:11.245-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:09:11.358-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:09:11.358-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:09:17.235-0500 W NETWORK [conn738] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:09:17.239-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:09:17.243-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:09:21.388-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:09:21.393-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:09:21.439-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:09:21.529-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:09:21.529-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:09:31.560-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:09:31.564-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:09:31.566-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:09:31.683-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:09:31.683-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:09:38.380-0500 W NETWORK [conn738] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:09:38.385-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:09:38.389-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:09:41.732-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:09:41.736-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:09:41.738-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:09:41.822-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:09:41.822-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:09:51.858-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:09:51.862-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:09:51.864-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:09:51.952-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:09:51.952-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:09:57.322-0500 W NETWORK [conn738] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:09:57.328-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:09:57.336-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:10:01.738-0500 W NETWORK [conn738] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:10:01.742-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:10:01.746-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:10:01.985-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:10:01.989-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:10:01.990-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:10:02.077-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:10:02.077-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:10:04.392-0500 W NETWORK [conn738] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:10:04.395-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:10:04.400-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:10:12.115-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:10:12.120-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:10:12.121-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:10:12.210-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:10:12.210-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:10:22.248-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:10:22.252-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:10:22.266-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:10:22.382-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:10:22.382-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:10:22.556-0500 W NETWORK [conn738] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:10:22.560-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:10:22.564-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:10:26.565-0500 W NETWORK [conn738] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:10:26.570-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:10:26.574-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:10:32.419-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:10:32.424-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:10:32.426-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:10:32.533-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:10:32.533-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:10:42.562-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:10:42.566-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:10:42.568-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:10:42.648-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:10:42.649-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:10:52.714-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:10:52.718-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:10:52.720-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:10:52.822-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:10:52.822-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:11:02.851-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:11:02.855-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:11:02.857-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:11:02.954-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:11:02.954-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:11:03.689-0500 W NETWORK [conn738] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:11:03.695-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:11:03.701-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:11:09.505-0500 W NETWORK [conn738] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:11:09.513-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:11:09.522-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:11:12.805-0500 W NETWORK [conn738] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:11:12.809-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:11:12.814-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:11:12.986-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:11:12.989-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:11:12.991-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:11:13.089-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:11:13.089-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:11:16.383-0500 W NETWORK [conn738] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:11:20.272-0500 W NETWORK [conn738] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:11:20.277-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:11:20.285-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:11:23.121-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:11:23.125-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:11:23.127-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:11:23.234-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:11:23.234-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:11:33.422-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:11:33.425-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:11:33.427-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:11:33.515-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:11:33.515-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:11:33.689-0500 W NETWORK [conn738] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:11:33.693-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:11:33.697-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:11:39.397-0500 W NETWORK [conn738] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:11:39.401-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:11:39.405-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:11:43.570-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:11:43.574-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:11:43.576-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:11:43.689-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:11:43.690-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:11:52.100-0500 W NETWORK [conn738] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:11:52.132-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:11:52.136-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:11:53.720-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:11:53.725-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:11:53.727-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:11:53.816-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:11:53.816-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:11:58.471-0500 W NETWORK [conn738] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:11:58.475-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:11:58.479-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:12:03.892-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:12:03.897-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:12:03.899-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:12:03.981-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:12:03.982-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:12:10.088-0500 W NETWORK [conn738] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:12:10.094-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:12:10.098-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:12:14.014-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:12:14.019-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:12:14.020-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:12:14.113-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:12:14.113-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:12:24.143-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:12:24.148-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:12:24.151-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:12:24.248-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:12:24.248-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:12:25.406-0500 W NETWORK [conn738] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:12:25.409-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:12:25.413-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:12:34.279-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:12:34.282-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:12:34.284-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:12:34.372-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:12:34.372-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:12:36.830-0500 W NETWORK [conn738] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:12:36.834-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:12:36.838-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:12:37.025-0500 W NETWORK [conn738] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:12:37.033-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:12:37.040-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:12:42.860-0500 W NETWORK [conn738] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:12:42.864-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:12:42.869-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:12:44.401-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:12:44.405-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:12:44.407-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:12:44.498-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:12:44.498-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:12:54.159-0500 W NETWORK [conn738] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:12:54.163-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:12:54.168-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:12:54.586-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:12:54.590-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:12:54.592-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:12:54.693-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:12:54.693-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:13:04.727-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:13:04.731-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:13:04.734-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:13:04.835-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:13:04.835-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:13:07.823-0500 W NETWORK [conn738] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:13:07.827-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:13:07.832-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:13:08.136-0500 W NETWORK [conn738] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:13:08.140-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:13:08.147-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:13:14.876-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:13:14.881-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:13:14.882-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:13:14.975-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:13:14.975-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:13:25.009-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:13:25.013-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:13:25.015-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:13:25.110-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:13:25.111-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:13:26.215-0500 W NETWORK [conn738] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:13:26.220-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:13:26.227-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:13:35.143-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:13:35.147-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:13:35.148-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:13:35.232-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:13:35.232-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:13:45.260-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:13:45.264-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:13:45.266-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:13:45.358-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:13:45.358-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:13:55.437-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:13:55.441-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:13:55.443-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:13:55.523-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:13:55.524-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:14:00.589-0500 W NETWORK [conn738] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:14:00.593-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:14:00.597-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:14:05.555-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:14:05.559-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:14:05.561-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:14:05.653-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:14:05.653-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:14:11.983-0500 W NETWORK [conn738] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:14:11.989-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:14:12.003-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:14:15.693-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:14:15.697-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:14:15.700-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:14:15.791-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:14:15.791-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:14:15.838-0500 W NETWORK [conn738] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:14:15.848-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:14:15.857-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:14:25.829-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:14:25.832-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:14:25.834-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:14:25.931-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:14:25.932-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:14:30.449-0500 W NETWORK [conn738] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:14:30.453-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:14:30.458-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:14:35.963-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:14:35.971-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:14:35.974-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:14:36.068-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:14:36.068-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:14:46.096-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:14:46.100-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:14:46.101-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:14:46.202-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:14:46.202-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:14:56.240-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:14:56.245-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:14:56.248-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:14:56.374-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:14:56.374-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:14:57.556-0500 W NETWORK [conn738] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:14:57.565-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:14:57.569-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:15:04.496-0500 W NETWORK [conn738] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:15:04.500-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:15:04.504-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:15:06.469-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:15:06.483-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:15:06.485-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:15:06.564-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:15:06.564-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:15:10.893-0500 W NETWORK [conn738] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:15:10.896-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:15:10.900-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:15:16.707-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:15:16.710-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:15:16.712-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:15:16.806-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:15:16.806-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:15:18.333-0500 W NETWORK [conn738] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:15:18.336-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:15:18.340-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:15:22.132-0500 W NETWORK [conn738] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:15:22.137-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:15:22.141-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:15:26.837-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:15:26.840-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:15:26.843-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:15:26.931-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:15:26.931-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:15:36.985-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:15:36.989-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:15:36.992-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:15:37.095-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:15:37.095-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:15:47.131-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:15:47.135-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:15:47.137-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:15:47.225-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:15:47.225-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:15:47.417-0500 W NETWORK [conn738] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:15:47.421-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:15:47.425-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:15:49.111-0500 W NETWORK [conn738] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:15:49.114-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:15:49.118-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:15:51.440-0500 W NETWORK [conn738] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:15:51.444-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:15:51.450-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:15:57.265-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:15:57.269-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:15:57.271-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:15:57.367-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:15:57.367-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:16:00.831-0500 W NETWORK [conn738] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:16:00.834-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:16:00.838-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:16:07.399-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:16:07.403-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:16:07.484-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:16:07.586-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:16:07.586-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:16:12.497-0500 W NETWORK [conn725] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:16:12.502-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:16:12.506-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:16:17.641-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:16:17.645-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:16:17.648-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:16:17.752-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:16:17.753-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:16:26.202-0500 W NETWORK [conn725] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:16:26.206-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:16:26.210-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:16:27.787-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:16:27.791-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:16:27.792-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:16:27.879-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:16:27.879-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:16:30.902-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:16:30.909-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:16:30.918-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:16:37.911-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:16:37.914-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:16:37.916-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:16:38.013-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:16:38.013-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:16:43.636-0500 W NETWORK [conn725] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:16:43.640-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:16:43.644-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:16:47.908-0500 W NETWORK [conn725] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:16:47.914-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:16:47.927-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:16:48.082-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:16:48.085-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:16:48.087-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:16:48.174-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:16:48.174-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:16:58.304-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:16:58.536-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:16:58.538-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:16:58.625-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:16:58.625-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:17:08.656-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:17:08.661-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:17:08.663-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:17:08.760-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:17:08.760-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:17:12.481-0500 W NETWORK [conn725] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:17:12.487-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:17:12.498-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:17:18.799-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:17:18.803-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:17:18.805-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:17:18.919-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:17:18.919-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:17:28.987-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:17:28.991-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:17:28.993-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:17:29.074-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:17:29.074-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:17:39.116-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:17:39.121-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:17:39.123-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:17:39.231-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:17:39.231-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:17:49.263-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:17:49.267-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:17:49.269-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:17:49.349-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:17:49.349-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:17:56.466-0500 W NETWORK [conn725] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:17:56.471-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:17:56.476-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:17:59.379-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:17:59.383-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:17:59.385-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:17:59.489-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:17:59.489-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:18:09.521-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:18:09.524-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:18:09.526-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:18:09.610-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:18:09.610-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:18:14.297-0500 W NETWORK [conn725] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:18:14.301-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:18:14.306-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:18:19.685-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:18:19.688-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:18:19.690-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:18:19.781-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:18:19.781-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:18:21.114-0500 W NETWORK [conn725] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:18:21.118-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:18:21.123-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:18:25.411-0500 W NETWORK [conn725] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:18:25.414-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:18:25.418-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:18:29.893-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:18:29.897-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:18:29.898-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:18:29.998-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:18:29.998-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:18:34.928-0500 W NETWORK [conn725] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:18:34.932-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:18:34.936-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:18:40.029-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:18:40.033-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:18:40.034-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:18:40.133-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:18:40.133-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:18:44.045-0500 W NETWORK [conn725] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:18:44.049-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:18:44.053-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:18:50.182-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:18:50.185-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:18:50.188-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:18:50.274-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:18:50.274-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:19:00.346-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:19:00.349-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:19:00.351-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:19:00.432-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:19:00.432-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:19:03.232-0500 W NETWORK [conn725] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:19:03.236-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:19:03.241-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:19:06.064-0500 W NETWORK [conn725] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:19:06.068-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:19:06.075-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:19:10.466-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:19:10.469-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:19:10.471-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:19:10.561-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:19:10.562-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:19:10.820-0500 W NETWORK [conn725] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:19:10.827-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:19:10.835-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:19:10.962-0500 W NETWORK [conn725] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:19:10.969-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:19:10.978-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:19:14.944-0500 W NETWORK [conn725] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:19:14.951-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:19:14.955-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:19:16.237-0500 W NETWORK [conn725] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:19:16.243-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:19:16.253-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:19:20.600-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:19:20.604-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:19:20.606-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:19:20.688-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:19:20.688-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:19:30.718-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:19:30.721-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:19:30.724-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:19:30.813-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:19:30.813-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:19:40.848-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:19:40.852-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:19:40.853-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:19:40.940-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:19:40.940-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:19:50.959-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:19:50.962-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:19:50.964-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:19:51.064-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:19:51.064-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:19:51.416-0500 W NETWORK [conn725] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:19:51.420-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:19:51.425-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:20:01.100-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:20:01.104-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:20:01.105-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:20:01.211-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:20:01.211-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:20:10.718-0500 W NETWORK [conn725] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:20:10.723-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:20:10.728-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:20:11.251-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:20:11.255-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:20:11.258-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:20:11.350-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:20:11.350-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:20:21.381-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:20:21.385-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:20:21.386-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:20:21.472-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:20:21.472-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:20:29.599-0500 W NETWORK [conn725] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:20:29.605-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:20:29.613-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:20:31.511-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:20:31.514-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:20:31.516-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:20:31.610-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:20:31.610-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:20:41.640-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:20:41.645-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:20:41.646-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:20:41.738-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:20:41.738-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:20:51.825-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:20:51.829-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:20:51.834-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:20:51.921-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:20:51.921-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:21:01.955-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:21:01.959-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:21:01.961-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:21:02.048-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:21:02.049-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:21:12.084-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:21:12.088-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:21:12.091-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:21:12.180-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:21:12.180-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:21:19.677-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:21:19.682-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:21:19.686-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:21:22.210-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:21:22.214-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:21:22.215-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:21:22.296-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:21:22.296-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:21:22.703-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:21:22.707-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:21:22.711-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:21:32.346-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:21:32.350-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:21:32.351-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:21:32.456-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:21:32.456-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:21:32.673-0500 W NETWORK [conn725] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:21:32.677-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:21:32.681-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:21:42.495-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:21:42.498-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:21:42.501-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:21:42.604-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:21:42.604-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:21:47.288-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:21:47.291-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:21:47.295-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:21:47.442-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:21:47.446-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:21:47.451-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:21:52.639-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:21:52.643-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:21:52.645-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:21:52.756-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:21:52.756-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:21:56.500-0500 W NETWORK [conn725] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:21:56.503-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:21:56.509-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:22:02.804-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:22:02.807-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:22:02.808-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:22:02.892-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:22:02.893-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:22:11.918-0500 W NETWORK [conn725] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:22:11.922-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:22:11.926-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:22:12.935-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:22:12.940-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:22:12.941-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:22:13.034-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:22:13.035-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:22:23.068-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:22:23.072-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:22:23.074-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:22:23.188-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:22:23.189-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:22:33.220-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:22:33.223-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:22:33.226-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:22:33.319-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:22:33.319-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:22:33.425-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:22:33.429-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:22:33.434-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:22:40.050-0500 W NETWORK [conn725] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:22:40.054-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:22:40.058-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:22:43.358-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:22:43.362-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:22:43.365-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:22:43.459-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:22:43.460-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:22:46.532-0500 W NETWORK [conn725] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:22:46.538-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:22:46.545-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:22:52.210-0500 W NETWORK [conn725] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:22:52.216-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:22:52.223-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:22:53.493-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:22:53.497-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:22:53.498-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:22:53.588-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:22:53.588-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:22:59.248-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:22:59.254-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:22:59.259-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:23:03.620-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:23:03.625-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:23:03.638-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:23:03.736-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:23:03.736-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:23:04.532-0500 W NETWORK [conn725] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:23:04.536-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:23:04.540-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:23:07.682-0500 W NETWORK [conn725] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:23:07.686-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:23:07.690-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:23:13.809-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:23:13.888-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:23:13.944-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:23:14.030-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:23:14.030-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:23:14.524-0500 W NETWORK [conn725] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:23:14.527-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:23:14.531-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:23:15.778-0500 W NETWORK [conn725] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:23:15.782-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:23:15.786-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:23:24.084-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:23:24.087-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:23:24.089-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:23:24.188-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:23:24.188-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:23:26.563-0500 W NETWORK [conn725] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:23:26.568-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:23:26.572-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:23:29.020-0500 W NETWORK [conn725] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:23:29.026-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:23:29.030-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:23:34.222-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:23:34.227-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:23:34.229-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:23:34.321-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:23:34.321-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:23:40.436-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:23:40.443-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:23:40.454-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:23:44.355-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:23:44.360-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:23:44.362-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:23:44.393-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:23:44.397-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:23:44.399-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:23:44.452-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:23:44.452-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:23:45.144-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:23:45.148-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:23:45.152-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:23:47.776-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:23:47.782-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:23:47.786-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:23:54.581-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:23:54.581-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:23:55.575-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:23:55.580-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:23:55.584-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:24:03.175-0500 W NETWORK [conn725] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:24:03.182-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:24:03.189-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:24:04.619-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:24:04.623-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:24:04.626-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:24:04.715-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:24:04.715-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:24:14.751-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:24:14.756-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:24:14.758-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:24:14.844-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:24:14.844-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:24:21.865-0500 W NETWORK [conn725] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:24:21.871-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:24:21.882-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:24:24.891-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:24:24.894-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:24:24.896-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:24:24.992-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:24:24.992-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:24:29.094-0500 W NETWORK [conn725] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:24:29.100-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:24:29.105-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:24:35.039-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:24:35.043-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:24:35.045-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:24:35.135-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:24:35.135-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:24:45.165-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:24:45.168-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:24:45.170-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:24:45.263-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:24:45.263-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:24:55.346-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:24:55.351-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:24:55.353-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:24:55.466-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:24:55.466-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:25:03.430-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:25:03.438-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:25:03.444-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:25:05.496-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:25:05.501-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:25:05.503-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:25:05.599-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:25:05.599-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:25:15.628-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:25:15.632-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:25:15.634-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:25:15.727-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:25:15.727-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:25:25.757-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:25:25.762-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:25:25.764-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:25:25.849-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:25:25.849-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:25:30.400-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:25:30.408-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:25:30.413-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:25:35.876-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:25:35.880-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:25:35.882-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:25:35.991-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:25:35.991-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:25:43.519-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:25:43.522-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:25:43.531-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:25:46.025-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:25:46.030-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:25:46.032-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:25:46.160-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:25:46.160-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:25:52.291-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:25:52.295-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:25:52.302-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:25:56.193-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:25:56.197-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:25:56.198-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:25:56.282-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:25:56.283-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:26:06.308-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:26:06.312-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:26:06.314-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:26:06.401-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:26:06.401-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:26:11.456-0500 W NETWORK [conn725] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:26:11.459-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:26:11.467-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:26:16.438-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:26:16.441-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:26:16.444-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:26:16.537-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:26:16.537-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:26:17.095-0500 W NETWORK [conn725] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:26:17.100-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:26:17.108-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:26:26.574-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:26:26.577-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:26:26.579-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:26:26.677-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:26:26.677-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:26:36.714-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:26:36.717-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:26:36.719-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:26:36.821-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:26:36.821-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:26:46.903-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:26:46.907-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:26:46.908-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:26:46.995-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:26:46.996-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:26:55.558-0500 W NETWORK [conn725] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:26:55.562-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:26:55.566-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:26:56.287-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:26:56.293-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:26:56.301-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:26:57.064-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:26:57.068-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:26:57.070-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:26:57.160-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:26:57.160-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:27:03.824-0500 W NETWORK [conn725] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:27:03.831-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:27:03.837-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:27:07.213-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:27:07.217-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:27:07.219-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:27:07.331-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:27:07.331-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:27:17.367-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:27:17.371-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:27:17.374-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:27:17.469-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:27:17.469-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:27:27.509-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:27:27.513-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:27:27.523-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:27:27.632-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:27:27.632-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:27:31.953-0500 W NETWORK [conn725] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:27:31.957-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:27:31.961-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:27:37.669-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:27:37.673-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:27:37.677-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:27:37.804-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:27:37.804-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:27:47.860-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:27:47.864-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:27:47.867-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:27:47.953-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:27:47.953-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:27:57.984-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:27:57.988-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:27:57.989-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:27:58.077-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:27:58.077-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:28:03.616-0500 W NETWORK [conn725] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:28:03.619-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:28:03.623-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:28:08.108-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:28:08.113-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:28:08.115-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:28:08.201-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:28:08.201-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:28:10.157-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:28:10.161-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:28:10.165-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:28:14.278-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:28:14.281-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:28:14.285-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:28:18.230-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:28:18.235-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:28:18.237-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:28:18.330-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:28:18.330-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:28:21.816-0500 W NETWORK [conn725] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:28:21.820-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:28:21.825-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:28:25.358-0500 W NETWORK [conn725] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:28:25.362-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:28:25.366-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:28:28.360-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:28:28.364-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:28:28.365-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:28:28.459-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:28:28.459-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:28:38.499-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:28:38.503-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:28:38.565-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:28:38.676-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:28:38.676-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:28:48.709-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:28:48.713-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:28:48.715-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:28:48.783-0500 I NETWORK [conn725] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:28:48.787-0500 I NETWORK [conn725] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:28:48.789-0500 I NETWORK [conn725] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:28:48.803-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:28:48.803-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:28:48.890-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:28:48.897-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:28:48.902-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:28:58.835-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:28:58.835-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:29:08.865-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:29:08.869-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:29:08.871-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:29:08.987-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:29:08.987-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:29:18.053-0500 W NETWORK [conn725] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:29:18.060-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:29:18.069-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:29:19.017-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:29:19.022-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:29:19.024-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:29:19.133-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:29:19.134-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:29:29.173-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:29:29.177-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:29:29.180-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:29:29.272-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:29:29.272-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:29:35.780-0500 W NETWORK [conn725] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:29:35.786-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:29:35.796-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:29:39.305-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:29:39.309-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:29:39.312-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:29:39.428-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:29:39.428-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:29:46.465-0500 W NETWORK [conn725] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:29:46.470-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:29:46.474-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:29:49.464-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:29:49.468-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:29:49.470-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:29:49.562-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:29:49.562-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:29:50.908-0500 W NETWORK [conn725] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:29:50.912-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:29:50.916-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:29:59.703-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:29:59.706-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:29:59.707-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:29:59.793-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:29:59.793-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:30:09.830-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:30:09.833-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:30:09.835-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:30:09.940-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:30:09.941-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:30:19.973-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:30:19.976-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:30:19.979-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:30:20.065-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:30:20.066-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:30:21.928-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:30:21.932-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:30:21.937-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:30:27.131-0500 W NETWORK [conn725] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:30:27.135-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:30:27.140-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:30:30.096-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:30:30.100-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:30:30.102-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:30:30.196-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:30:30.197-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:30:37.206-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:30:37.214-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:30:37.221-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:30:40.258-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:30:40.263-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:30:40.266-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:30:40.363-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:30:40.363-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:30:45.834-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:30:45.838-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:30:45.845-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:30:46.023-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:30:46.027-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:30:46.031-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:30:50.407-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:30:50.412-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:30:50.413-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:30:50.504-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:30:50.505-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:30:54.473-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:30:54.477-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:30:54.482-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:31:00.534-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:31:00.539-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:31:00.541-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:31:00.638-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:31:00.638-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:31:02.857-0500 W NETWORK [conn725] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:31:02.864-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:31:02.874-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:31:10.674-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:31:10.678-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:31:10.680-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:31:10.776-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:31:10.776-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:31:15.572-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:31:15.579-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:31:15.586-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:31:20.940-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:31:20.944-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:31:20.945-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:31:21.044-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:31:21.044-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:31:21.419-0500 W NETWORK [conn725] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:31:21.423-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:31:21.430-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:31:28.917-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:31:28.921-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:31:28.927-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:31:31.073-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:31:31.077-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:31:31.079-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:31:31.167-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:31:31.167-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:31:41.199-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:31:41.203-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:31:41.205-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:31:41.301-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:31:41.302-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:31:46.824-0500 W NETWORK [conn725] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:31:46.828-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:31:46.834-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:31:51.338-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:31:51.343-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:31:51.347-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:31:51.436-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:31:51.436-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:32:01.470-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:32:01.473-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:32:01.475-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:32:01.563-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:32:01.563-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:32:11.617-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:32:11.621-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:32:11.624-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:32:11.722-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:32:11.723-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:32:12.000-0500 W NETWORK [conn725] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:32:12.007-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:32:12.012-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:32:13.085-0500 W NETWORK [conn725] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:32:13.089-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:32:13.093-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:32:16.422-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:32:16.425-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:32:16.429-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:32:16.718-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:32:16.723-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:32:16.728-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:32:21.765-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:32:21.769-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:32:21.771-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:32:21.876-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:32:21.876-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:32:28.229-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:32:28.235-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:32:28.240-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:32:31.905-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:32:31.909-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:32:31.966-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:32:32.063-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:32:32.063-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:32:42.094-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:32:42.098-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:32:42.100-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:32:42.244-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:32:42.245-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:32:52.282-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:32:52.286-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:32:52.289-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:32:52.385-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:32:52.385-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:33:02.519-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:33:02.523-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:33:02.526-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:33:02.619-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:33:02.619-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:33:12.680-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:33:12.684-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:33:12.686-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:33:12.781-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:33:12.781-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:33:20.001-0500 W NETWORK [conn725] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:33:20.008-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:33:20.013-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:33:22.812-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:33:22.815-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:33:22.817-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:33:22.901-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:33:22.902-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:33:32.945-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:33:32.948-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:33:32.951-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:33:33.048-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:33:33.048-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:33:36.235-0500 W NETWORK [conn725] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:33:36.238-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:33:36.242-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:33:43.077-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:33:43.080-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:33:43.082-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:33:43.178-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:33:43.178-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:33:53.229-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:33:53.233-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:33:53.236-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:33:53.345-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:33:53.345-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:34:03.390-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:34:03.393-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:34:03.395-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:34:03.490-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:34:03.490-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:34:13.526-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:34:13.529-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:34:13.532-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:34:13.620-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:34:13.620-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:34:23.656-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:34:23.662-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:34:23.664-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:34:23.769-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:34:23.769-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:34:33.804-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:34:33.809-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:34:33.811-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:34:33.930-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:34:33.930-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:34:44.006-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:34:44.010-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:34:44.012-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:34:44.113-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:34:44.114-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:34:48.652-0500 W NETWORK [conn725] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:34:48.656-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:34:48.661-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:34:54.214-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:34:54.218-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:34:54.220-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:34:54.330-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:34:54.330-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:35:04.363-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:35:04.367-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:35:04.369-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:35:04.480-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:35:04.480-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:35:10.124-0500 W NETWORK [conn738] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:10.815-0500 W NETWORK [conn738] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:10.818-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:35:10.823-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:35:11.095-0500 W NETWORK [conn738] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:11.101-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:35:11.108-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:35:11.467-0500 W NETWORK [conn738] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:11.471-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:35:11.476-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:35:11.837-0500 W NETWORK [conn738] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:12.040-0500 W NETWORK [conn738] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:12.050-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:35:12.057-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:35:12.662-0500 W NETWORK [conn727] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:13.130-0500 W NETWORK [conn727] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:13.180-0500 W NETWORK [conn725] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:13.821-0500 W NETWORK [conn725] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:14.343-0500 W NETWORK [conn725] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:14.347-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:35:14.352-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:35:14.526-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:35:14.530-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:35:14.533-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:35:14.618-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:35:14.619-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:35:14.621-0500 I NETWORK [conn738] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:35:14.625-0500 I NETWORK [conn738] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:35:14.626-0500 I NETWORK [conn738] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:35:14.714-0500 W NETWORK [conn738] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:14.716-0500 W NETWORK [conn725] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:15.135-0500 W NETWORK [conn738] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:15.167-0500 W NETWORK [conn738] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:15.233-0500 W NETWORK [conn738] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:15.286-0500 W NETWORK [conn725] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:15.560-0500 W NETWORK [conn738] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:15.564-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:35:15.568-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:35:15.594-0500 W NETWORK [conn738] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:15.759-0500 W NETWORK [conn727] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:15.764-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:35:15.768-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:35:16.060-0500 W NETWORK [conn727] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:16.082-0500 W NETWORK [conn727] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:16.087-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:35:16.092-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:35:16.110-0500 W NETWORK [conn727] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:16.113-0500 I - [conn736] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:35:16.117-0500 I CONTROL [conn736] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:35:16.164-0500 W NETWORK [conn725] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:16.316-0500 W NETWORK [conn727] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:16.331-0500 W NETWORK [conn738] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:16.544-0500 W NETWORK [conn727] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:16.861-0500 W NETWORK [conn725] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:16.913-0500 W NETWORK [conn725] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:17.146-0500 W NETWORK [conn725] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:17.152-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:35:17.160-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:35:17.194-0500 W NETWORK [conn725] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:17.382-0500 W NETWORK [conn727] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:17.519-0500 W NETWORK [conn738] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:17.662-0500 W NETWORK [conn738] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:17.668-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:35:17.672-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:35:17.744-0500 W NETWORK [conn725] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:17.890-0500 W NETWORK [conn725] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:18.013-0500 W NETWORK [conn725] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:18.150-0500 W NETWORK [conn725] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:18.212-0500 W NETWORK [conn725] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:18.244-0500 W NETWORK [conn738] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:18.432-0500 W NETWORK [conn725] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:18.493-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:18.529-0500 W NETWORK [conn738] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:18.550-0500 W NETWORK [conn738] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:18.622-0500 W NETWORK [conn738] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:18.691-0500 W NETWORK [conn725] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:19.000-0500 W NETWORK [conn727] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:19.167-0500 W NETWORK [conn738] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:19.404-0500 W NETWORK [conn727] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:19.548-0500 W NETWORK [conn738] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:19.680-0500 W NETWORK [conn725] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:19.919-0500 W NETWORK [conn725] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:19.922-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:35:19.927-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:35:20.245-0500 W NETWORK [conn727] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:20.394-0500 W NETWORK [conn725] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:20.559-0500 W NETWORK [conn738] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:20.879-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:20.993-0500 W NETWORK [conn725] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:21.008-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:21.100-0500 W NETWORK [conn725] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:21.154-0500 W NETWORK [conn725] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:21.191-0500 W NETWORK [conn738] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:21.649-0500 W NETWORK [conn736] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:21.805-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:21.812-0500 W NETWORK [conn725] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:21.917-0500 W NETWORK [conn738] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:21.961-0500 W NETWORK [conn738] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:22.099-0500 W NETWORK [conn736] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:22.130-0500 W NETWORK [conn736] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:22.139-0500 W NETWORK [conn736] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:22.195-0500 W NETWORK [conn736] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:22.243-0500 W NETWORK [conn738] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:22.259-0500 W NETWORK [conn736] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:22.335-0500 W NETWORK [conn725] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:22.493-0500 W NETWORK [conn736] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:22.495-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:22.501-0500 W NETWORK [conn727] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:22.504-0500 I - [conn736] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:35:22.510-0500 I CONTROL [conn736] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:35:22.522-0500 W NETWORK [conn736] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:22.544-0500 W NETWORK [conn736] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:22.551-0500 W NETWORK [conn736] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:22.598-0500 W NETWORK [conn736] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:22.670-0500 W NETWORK [conn736] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:22.717-0500 W NETWORK [conn736] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:22.726-0500 W NETWORK [conn736] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:22.766-0500 W NETWORK [conn736] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:22.801-0500 W NETWORK [conn736] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:22.815-0500 W NETWORK [conn736] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:22.857-0500 W NETWORK [conn736] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:22.925-0500 W NETWORK [conn736] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:22.930-0500 W NETWORK [conn736] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:22.958-0500 W NETWORK [conn736] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:22.958-0500 W NETWORK [conn738] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:22.978-0500 W NETWORK [conn738] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:22.981-0500 W NETWORK [conn736] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:23.010-0500 W NETWORK [conn738] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:23.016-0500 W NETWORK [conn738] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:23.041-0500 W NETWORK [conn738] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:23.045-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:35:23.049-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:35:23.156-0500 W NETWORK [conn738] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:23.190-0500 W NETWORK [conn738] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:23.209-0500 W NETWORK [conn738] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:23.227-0500 W NETWORK [conn738] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:23.280-0500 W NETWORK [conn738] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:23.280-0500 W NETWORK [conn736] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:23.310-0500 W NETWORK [conn736] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:23.311-0500 W NETWORK [conn738] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:23.315-0500 W NETWORK [conn738] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:23.338-0500 W NETWORK [conn738] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:23.436-0500 I NETWORK [conn727] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:35:23.438-0500 I NETWORK [conn737] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:35:23.438-0500 W NETWORK [conn738] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:23.439-0500 W NETWORK [conn736] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:23.445-0500 I NETWORK [conn737] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:35:23.446-0500 I NETWORK [conn727] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:35:23.447-0500 I NETWORK [conn737] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:35:23.448-0500 I NETWORK [conn727] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:35:23.484-0500 W NETWORK [conn725] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:23.504-0500 W NETWORK [conn725] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:23.539-0500 W NETWORK [conn737] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:23.549-0500 W NETWORK [conn727] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:23.595-0500 W NETWORK [conn737] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:23.615-0500 W NETWORK [conn725] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:23.623-0500 W NETWORK [conn727] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:23.627-0500 W NETWORK [conn727] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:23.749-0500 W NETWORK [conn727] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:23.761-0500 W NETWORK [conn727] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:23.828-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:23.908-0500 W NETWORK [conn727] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:23.915-0500 W NETWORK [conn727] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:23.944-0500 W NETWORK [conn727] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:23.984-0500 W NETWORK [conn727] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:24.029-0500 W NETWORK [conn727] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:24.050-0500 W NETWORK [conn727] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:24.109-0500 W NETWORK [conn727] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:24.109-0500 W NETWORK [conn725] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:24.143-0500 W NETWORK [conn725] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:24.201-0500 W NETWORK [conn725] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:24.259-0500 W NETWORK [conn727] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:24.309-0500 W NETWORK [conn727] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:24.341-0500 W NETWORK [conn725] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:24.427-0500 W NETWORK [conn725] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:24.479-0500 W NETWORK [conn727] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:24.483-0500 W NETWORK [conn737] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:24.513-0500 W NETWORK [conn737] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:24.652-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:35:24.652-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:35:24.720-0500 W NETWORK [conn738] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:24.768-0500 W NETWORK [conn726] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:24.785-0500 W NETWORK [conn726] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:24.879-0500 W NETWORK [conn737] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:24.922-0500 W NETWORK [conn727] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:25.112-0500 W NETWORK [conn727] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:25.124-0500 W NETWORK [conn727] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:25.203-0500 W NETWORK [conn727] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:25.209-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:25.220-0500 W NETWORK [conn725] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:25.259-0500 W NETWORK [conn727] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:25.287-0500 W NETWORK [conn725] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:25.321-0500 W NETWORK [conn727] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:25.448-0500 W NETWORK [conn725] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:25.449-0500 W NETWORK [conn727] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:25.450-0500 W NETWORK [conn737] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:25.451-0500 W NETWORK [conn726] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:25.496-0500 W NETWORK [conn737] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:25.506-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:35:25.511-0500 W NETWORK [conn727] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:25.516-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:35:25.525-0500 W NETWORK [conn737] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:25.549-0500 W NETWORK [conn737] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:25.600-0500 W NETWORK [conn737] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:25.654-0500 W NETWORK [conn737] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:25.716-0500 W NETWORK [conn737] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:25.736-0500 W NETWORK [conn737] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:25.750-0500 W NETWORK [conn737] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:25.756-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:35:25.762-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:35:25.938-0500 W NETWORK [conn737] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:25.939-0500 W NETWORK [conn726] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:26.023-0500 W NETWORK [conn727] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:26.142-0500 W NETWORK [conn727] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:26.174-0500 W NETWORK [conn727] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:26.198-0500 W NETWORK [conn737] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:26.221-0500 W NETWORK [conn737] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:26.249-0500 W NETWORK [conn737] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:26.258-0500 W NETWORK [conn737] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:26.312-0500 W NETWORK [conn737] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:26.355-0500 W NETWORK [conn737] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:26.460-0500 W NETWORK [conn726] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:26.614-0500 W NETWORK [conn726] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:26.624-0500 W NETWORK [conn726] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:26.642-0500 W NETWORK [conn726] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:26.689-0500 W NETWORK [conn726] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:26.721-0500 W NETWORK [conn726] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:26.792-0500 W NETWORK [conn726] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:26.906-0500 W NETWORK [conn726] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:26.948-0500 W NETWORK [conn726] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:26.996-0500 W NETWORK [conn737] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:27.038-0500 W NETWORK [conn737] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:27.120-0500 W NETWORK [conn737] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:27.224-0500 W NETWORK [conn737] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:27.242-0500 W NETWORK [conn737] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:27.298-0500 W NETWORK [conn737] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:27.363-0500 W NETWORK [conn726] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:27.419-0500 W NETWORK [conn737] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:27.498-0500 W NETWORK [conn737] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:27.538-0500 W NETWORK [conn726] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:27.633-0500 W NETWORK [conn726] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:27.718-0500 W NETWORK [conn726] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:27.749-0500 W NETWORK [conn726] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:27.851-0500 W NETWORK [conn737] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:27.905-0500 W NETWORK [conn737] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:27.934-0500 W NETWORK [conn737] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:27.953-0500 W NETWORK [conn737] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:27.992-0500 W NETWORK [conn737] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:28.048-0500 W NETWORK [conn737] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:28.075-0500 W NETWORK [conn726] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:28.119-0500 W NETWORK [conn737] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:28.153-0500 W NETWORK [conn726] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:28.191-0500 W NETWORK [conn726] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:28.207-0500 W NETWORK [conn726] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:28.230-0500 W NETWORK [conn726] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:28.230-0500 W NETWORK [conn737] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:28.275-0500 W NETWORK [conn737] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:28.308-0500 W NETWORK [conn737] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:28.333-0500 W NETWORK [conn726] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:28.339-0500 W NETWORK [conn726] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:28.455-0500 W NETWORK [conn737] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:28.507-0500 W NETWORK [conn726] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:28.551-0500 W NETWORK [conn726] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:28.653-0500 W NETWORK [conn726] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:28.675-0500 W NETWORK [conn737] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:28.734-0500 W NETWORK [conn737] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:28.765-0500 W NETWORK [conn737] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:28.997-0500 W NETWORK [conn737] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:29.688-0500 W NETWORK [conn737] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:29.799-0500 W NETWORK [conn737] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:30.052-0500 W NETWORK [conn726] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:30.079-0500 W NETWORK [conn737] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:30.102-0500 W NETWORK [conn737] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:31.342-0500 W NETWORK [conn726] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:31.347-0500 I - [conn726] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:35:31.352-0500 I CONTROL [conn726] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:35:31.473-0500 W NETWORK [conn727] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:31.681-0500 W NETWORK [conn726] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:31.823-0500 W NETWORK [conn727] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:31.831-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:35:31.836-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:35:32.864-0500 W NETWORK [conn737] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:32.869-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:35:32.873-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:35:34.686-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:35:34.686-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:35:34.868-0500 W NETWORK [conn737] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:34.874-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:35:34.878-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:35:36.077-0500 W NETWORK [conn737] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:36.332-0500 W NETWORK [conn737] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:36.365-0500 W NETWORK [conn737] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:36.865-0500 W NETWORK [conn737] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:37.570-0500 W NETWORK [conn737] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:37.574-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:35:37.579-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:35:43.160-0500 W NETWORK [conn737] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:35:43.163-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:35:43.168-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:35:44.734-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:35:44.734-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:35:54.769-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:35:54.773-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:35:54.775-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:35:54.874-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:35:54.874-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:36:04.911-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:36:04.915-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:36:04.918-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:36:05.007-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:36:05.007-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:36:15.069-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:36:15.129-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:36:15.132-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:36:15.227-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:36:15.227-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:36:25.285-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:36:25.293-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:36:25.295-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:36:25.396-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:36:25.396-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:36:35.579-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:36:35.585-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:36:35.587-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:36:35.682-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:36:35.682-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:36:45.714-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:36:45.718-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:36:45.719-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:36:45.827-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:36:45.827-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:36:55.867-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:36:55.871-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:36:55.874-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:36:55.976-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:36:55.976-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:37:06.015-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:37:06.019-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:37:06.020-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:37:06.114-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:37:06.115-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:37:09.745-0500 W NETWORK [conn737] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:37:09.751-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:37:09.759-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:37:11.353-0500 W NETWORK [conn737] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:37:11.357-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:37:11.361-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:37:16.170-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:37:16.174-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:37:16.176-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:37:16.299-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:37:16.300-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:37:22.212-0500 W NETWORK [conn737] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:37:22.216-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:37:22.220-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:37:22.528-0500 W NETWORK [conn737] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:37:22.541-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:37:22.555-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:37:26.351-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:37:26.355-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:37:26.357-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:37:26.462-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:37:26.462-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:37:36.499-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:37:36.503-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:37:36.504-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:37:36.599-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:37:36.599-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:37:46.634-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:37:46.637-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:37:46.640-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:37:46.731-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:37:46.731-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:37:56.812-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:37:56.816-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:37:56.819-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:37:56.911-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:37:56.911-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:38:06.950-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:38:06.953-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:38:06.955-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:38:07.055-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:38:07.055-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:38:16.540-0500 W NETWORK [conn737] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:38:16.543-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:38:16.547-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:38:17.080-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:38:17.084-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:38:17.085-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:38:17.176-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:38:17.176-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:38:27.198-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:38:27.204-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:38:27.206-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:38:27.309-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:38:27.309-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:38:37.358-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:38:37.367-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:38:37.370-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:38:37.460-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:38:37.460-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:38:37.515-0500 W NETWORK [conn737] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:38:37.519-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:38:37.525-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:38:47.505-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:38:47.579-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:38:47.581-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:38:47.678-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:38:47.678-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:38:57.735-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:38:57.739-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:38:57.741-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:38:57.836-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:38:57.836-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:39:03.982-0500 W NETWORK [conn737] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:39:03.986-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:39:03.992-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:39:07.853-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:39:07.856-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:39:07.858-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:39:07.946-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:39:07.946-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:39:17.984-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:39:17.988-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:39:17.989-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:39:18.079-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:39:18.079-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:39:24.680-0500 W NETWORK [conn737] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:39:24.683-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:39:24.688-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:39:28.116-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:39:28.120-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:39:28.124-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:39:28.220-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:39:28.220-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:39:38.253-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:39:38.268-0500 W NETWORK [conn737] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:39:38.271-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:39:38.272-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:39:38.276-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:39:38.280-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:39:38.393-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:39:38.393-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:39:48.472-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:39:48.475-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:39:48.477-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:39:48.627-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:39:48.627-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:39:58.667-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:39:58.671-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:39:58.672-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:39:58.755-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:39:58.755-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:40:06.342-0500 W NETWORK [conn737] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:40:06.345-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:40:06.349-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:40:08.793-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:40:08.797-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:40:08.801-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:40:08.898-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:40:08.898-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:40:18.928-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:40:18.931-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:40:18.933-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:40:19.037-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:40:19.037-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:40:25.390-0500 W NETWORK [conn737] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:40:25.394-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:40:25.400-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:40:29.077-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:40:29.081-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:40:29.082-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:40:29.194-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:40:29.194-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:40:35.227-0500 W NETWORK [conn737] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:40:35.232-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:40:35.236-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:40:39.247-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:40:39.251-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:40:39.254-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:40:39.372-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:40:39.372-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:40:45.473-0500 W NETWORK [conn737] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:40:45.477-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:40:45.481-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:40:49.406-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:40:49.496-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:40:49.499-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:40:49.591-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:40:49.591-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:40:59.611-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:40:59.615-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:40:59.617-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:40:59.719-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:40:59.719-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:41:06.633-0500 W NETWORK [conn737] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:41:06.637-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:41:06.641-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:41:09.739-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:41:09.745-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:41:09.748-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:41:09.849-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:41:09.849-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:41:10.076-0500 W NETWORK [conn737] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:41:10.083-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:41:10.093-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:41:19.888-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:41:19.892-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:41:20.003-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:41:20.100-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:41:20.101-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:41:30.240-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:41:30.244-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:41:30.246-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:41:30.332-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:41:30.332-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:41:40.364-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:41:40.368-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:41:40.370-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:41:40.469-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:41:40.469-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:41:50.489-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:41:50.493-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:41:50.496-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:41:50.591-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:41:50.591-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:42:00.647-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:42:00.652-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:42:00.655-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:42:00.764-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:42:00.764-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:42:02.542-0500 W NETWORK [conn737] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:42:02.548-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:42:02.553-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:42:04.072-0500 W NETWORK [conn737] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:42:04.080-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:42:04.084-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:42:07.186-0500 W NETWORK [conn737] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:42:07.190-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:42:07.195-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:42:10.817-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:42:10.820-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:42:10.822-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:42:10.930-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:42:10.930-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:42:20.963-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:42:20.968-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:42:20.970-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:42:21.056-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:42:21.056-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:42:24.190-0500 W NETWORK [conn737] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:42:24.194-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:42:24.200-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:42:31.083-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:42:31.087-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:42:31.090-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:42:31.193-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:42:31.193-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:42:41.211-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:42:41.215-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:42:41.216-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:42:41.309-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:42:41.309-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:42:45.552-0500 W NETWORK [conn737] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:42:45.556-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:42:45.560-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:42:47.007-0500 W NETWORK [conn737] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:42:47.011-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:42:47.015-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:42:51.342-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:42:51.346-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:42:51.348-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:42:51.451-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:42:51.451-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:43:01.486-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:43:01.490-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:43:01.492-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:43:01.577-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:43:01.577-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:43:11.731-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:43:11.742-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:43:11.749-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:43:11.843-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:43:11.845-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:43:21.881-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:43:21.885-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:43:21.887-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:43:21.981-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:43:21.981-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:43:24.025-0500 W NETWORK [conn737] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:43:24.028-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:43:24.032-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:43:32.016-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:43:32.020-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:43:32.022-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:43:32.110-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:43:32.110-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:43:42.145-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:43:42.150-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:43:42.154-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:43:42.248-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:43:42.248-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:43:52.297-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:43:52.301-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:43:52.303-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:43:52.401-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:43:52.401-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:44:02.553-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:44:02.556-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:44:02.558-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:44:02.655-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:44:02.655-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:44:11.365-0500 W NETWORK [conn737] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:44:11.371-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:44:11.375-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:44:12.686-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:44:12.690-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:44:12.691-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:44:12.790-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:44:12.791-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:44:22.883-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:44:22.888-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:44:22.891-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:44:22.994-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:44:22.994-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:44:33.026-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:44:33.032-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:44:33.034-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:44:33.125-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:44:33.126-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:44:43.159-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:44:43.163-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:44:43.164-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:44:43.271-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:44:43.271-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:44:53.309-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:44:53.313-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:44:53.315-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:44:53.402-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:44:53.402-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:45:03.514-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:45:03.517-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:45:03.519-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:45:03.626-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:45:03.626-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:45:06.484-0500 W NETWORK [conn737] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:45:06.488-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:45:06.493-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:45:11.679-0500 W NETWORK [conn737] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:45:11.686-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:45:11.697-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:45:13.656-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:45:13.660-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:45:13.661-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:45:13.757-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:45:13.757-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:45:17.062-0500 W NETWORK [conn737] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:45:17.066-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:45:17.070-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:45:23.846-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:45:23.849-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:45:23.851-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:45:23.951-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:45:23.952-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:45:34.000-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:45:34.005-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:45:34.008-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:45:34.102-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:45:34.102-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:45:42.468-0500 W NETWORK [conn737] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:45:42.472-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:45:42.476-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:45:44.131-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:45:44.134-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:45:44.137-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:45:44.228-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:45:44.228-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:45:54.274-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:45:54.277-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:45:54.280-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:45:54.379-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:45:54.379-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:46:03.433-0500 W NETWORK [conn737] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:46:03.437-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:46:03.441-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:46:03.646-0500 W NETWORK [conn737] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:46:03.650-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:46:03.655-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:46:04.410-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:46:04.415-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:46:04.417-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:46:04.530-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:46:04.530-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:46:06.623-0500 W NETWORK [conn737] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:46:06.631-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:46:06.639-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:46:14.562-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:46:14.565-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:46:14.567-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:46:14.664-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:46:14.664-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:46:24.701-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:46:24.705-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:46:24.707-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:46:24.826-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:46:24.827-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:46:33.796-0500 W NETWORK [conn737] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:46:33.801-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:46:33.806-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:46:34.856-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:46:34.860-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:46:34.862-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:46:34.966-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:46:34.966-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:46:44.995-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:46:45.000-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:46:45.002-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:46:45.111-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:46:45.111-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:46:55.135-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:46:55.138-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:46:55.141-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:46:55.229-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:46:55.229-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:46:56.366-0500 W NETWORK [conn737] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:46:56.369-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:46:56.373-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:46:57.190-0500 W NETWORK [conn737] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:46:57.194-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:46:57.198-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:47:04.532-0500 W NETWORK [conn737] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:47:04.538-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:47:04.544-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:47:05.281-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:47:05.285-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:47:05.287-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:47:05.374-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:47:05.374-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:47:11.273-0500 W NETWORK [conn737] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:47:11.277-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:47:11.286-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:47:15.403-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:47:15.408-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:47:15.410-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:47:15.507-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:47:15.507-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:47:25.535-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:47:25.540-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:47:25.542-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:47:25.633-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:47:25.633-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:47:29.304-0500 W NETWORK [conn737] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:47:29.308-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:47:29.312-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:47:35.694-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:47:35.698-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:47:35.700-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:47:35.785-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:47:35.785-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:47:36.996-0500 W NETWORK [conn737] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:47:37.002-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:47:37.009-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:47:45.815-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:47:45.819-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:47:45.822-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:47:45.931-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:47:45.931-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:47:55.973-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:47:55.976-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:47:55.979-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:47:56.076-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:47:56.076-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:48:06.106-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:48:06.176-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:48:06.178-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:48:06.284-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:48:06.284-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:48:16.343-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:48:16.432-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:48:16.443-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:48:16.526-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:48:16.526-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:48:26.554-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:48:26.557-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:48:26.559-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:48:26.654-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:48:26.654-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:48:36.690-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:48:36.694-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:48:36.696-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:48:36.799-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:48:36.799-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:48:46.831-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:48:46.835-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:48:46.837-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:48:46.918-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:48:46.918-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:48:56.951-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:48:56.954-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:48:56.956-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:48:57.053-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:48:57.056-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:49:07.087-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:49:07.091-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:49:07.092-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:49:07.178-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:49:07.178-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:49:10.395-0500 W NETWORK [conn737] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:49:10.399-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:49:10.404-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:49:17.227-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:49:17.230-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:49:17.232-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:49:17.332-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:49:17.332-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:49:27.363-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:49:27.367-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:49:27.369-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:49:27.488-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:49:27.489-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:49:36.592-0500 W NETWORK [conn737] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:49:36.600-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:49:36.608-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:49:37.520-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:49:37.525-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:49:37.527-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:49:37.633-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:49:37.633-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:49:47.668-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:49:47.672-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:49:47.674-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:49:47.761-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:49:47.762-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:49:57.795-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:49:57.799-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:49:57.800-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:49:57.904-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:49:57.904-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:50:07.940-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:50:07.945-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:50:07.948-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:50:08.059-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:50:08.059-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:50:18.089-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:50:18.093-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:50:18.095-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:50:18.200-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:50:18.200-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:50:28.235-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:50:28.239-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:50:28.241-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:50:28.329-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:50:28.329-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:50:38.363-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:50:38.367-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:50:38.368-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:50:38.464-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:50:38.464-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:50:48.491-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:50:48.494-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:50:48.496-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:50:48.610-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:50:48.610-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:50:55.093-0500 W NETWORK [conn737] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:50:55.101-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:50:55.110-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:50:58.639-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:50:58.643-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:50:58.644-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:50:58.731-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:50:58.731-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:51:00.538-0500 W NETWORK [conn737] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:51:00.545-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:51:00.554-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:51:01.497-0500 W NETWORK [conn737] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:51:01.501-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:51:01.505-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:51:08.783-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:51:08.786-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:51:08.789-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:51:08.895-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:51:08.895-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:51:18.928-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:51:18.933-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:51:18.934-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:51:19.038-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:51:19.039-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:51:29.080-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:51:29.083-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:51:29.085-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:51:29.181-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:51:29.182-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:51:39.216-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:51:39.220-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:51:39.222-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:51:39.313-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:51:39.314-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:51:42.894-0500 W NETWORK [conn737] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:51:42.898-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:51:42.902-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:51:43.649-0500 W NETWORK [conn737] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:51:43.654-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:51:43.660-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:51:49.351-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:51:49.356-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:51:49.357-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:51:49.451-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:51:49.451-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:51:51.162-0500 W NETWORK [conn737] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:51:51.166-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:51:51.170-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:51:59.499-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:51:59.504-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:51:59.507-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:51:59.597-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:51:59.597-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:52:03.753-0500 W NETWORK [conn737] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:52:03.759-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:52:03.768-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:52:09.651-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:52:09.656-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:52:09.658-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:52:09.745-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:52:09.745-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:52:18.110-0500 W NETWORK [conn737] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:52:18.115-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:52:18.120-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:52:19.789-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:52:19.793-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:52:19.795-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:52:19.893-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:52:19.893-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:52:23.500-0500 W NETWORK [conn737] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:52:23.504-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:52:23.508-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:52:29.980-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:52:29.984-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:52:29.986-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:52:30.083-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:52:30.083-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:52:40.112-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:52:40.117-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:52:40.120-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:52:40.212-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:52:40.212-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:52:46.005-0500 W NETWORK [conn737] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:52:46.011-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:52:46.020-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:52:50.291-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:52:50.296-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:52:50.298-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:52:50.388-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:52:50.388-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:53:00.422-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:53:00.425-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:53:00.427-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:53:00.533-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:53:00.533-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:53:03.859-0500 W NETWORK [conn737] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:53:03.862-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:53:03.867-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:53:10.564-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:53:10.568-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:53:10.570-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:53:10.662-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:53:10.662-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:53:20.692-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:53:20.695-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:53:20.697-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:53:20.816-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:53:20.817-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:53:30.848-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:53:30.852-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:53:30.853-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:53:30.958-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:53:30.958-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:53:40.992-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:53:40.995-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:53:40.997-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:53:41.028-0500 I NETWORK [conn737] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:53:41.031-0500 I NETWORK [conn737] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:53:41.034-0500 I NETWORK [conn737] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:53:41.087-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:53:41.087-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:53:41.134-0500 W NETWORK [conn737] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:53:41.139-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:53:41.144-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:53:51.122-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:53:51.122-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:54:01.152-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:54:01.156-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:54:01.157-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:54:01.245-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:54:01.245-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:54:01.673-0500 W NETWORK [conn737] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:54:01.677-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:54:01.683-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:54:04.810-0500 W NETWORK [conn737] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:54:04.816-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:54:04.825-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:54:06.030-0500 W NETWORK [conn737] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:54:06.035-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:54:06.040-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:54:09.172-0500 W NETWORK [conn737] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:54:09.179-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:54:09.185-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:54:11.290-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:54:11.295-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:54:11.298-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:54:11.400-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:54:11.400-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:54:21.495-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:54:21.498-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:54:21.501-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:54:21.590-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:54:21.590-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:54:28.113-0500 W NETWORK [conn737] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:54:28.117-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:54:28.121-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:54:31.621-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:54:31.624-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:54:31.626-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:54:31.720-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:54:31.720-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:54:41.750-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:54:41.755-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:54:41.758-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:54:41.848-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:54:41.848-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:54:51.884-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:54:51.888-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:54:51.889-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:54:51.981-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:54:51.981-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:55:02.020-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:55:02.024-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:55:02.026-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:55:02.127-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:55:02.127-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:55:12.175-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:55:12.179-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:55:12.181-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:55:12.277-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:55:12.277-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:55:13.983-0500 W NETWORK [conn737] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:55:13.987-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:55:13.991-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:55:22.308-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:55:22.311-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:55:22.313-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:55:22.425-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:55:22.426-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:55:32.457-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:55:32.460-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:55:32.463-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:55:32.546-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:55:32.546-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:55:39.308-0500 W NETWORK [conn737] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:55:39.313-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:55:39.317-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:55:40.034-0500 W NETWORK [conn737] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:55:40.037-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:55:40.042-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:55:42.584-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:55:42.588-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:55:42.590-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:55:42.686-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:55:42.687-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:55:44.104-0500 W NETWORK [conn737] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:55:44.109-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:55:44.114-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:55:52.789-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:55:52.793-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:55:52.795-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:55:52.889-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:55:52.889-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:56:02.950-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:56:02.956-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:56:02.958-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:56:03.082-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:56:03.082-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:56:13.115-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:56:13.118-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:56:13.120-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:56:13.216-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:56:13.218-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:56:23.358-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:56:23.363-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:56:23.364-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:56:23.469-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:56:23.470-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:56:33.502-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:56:33.507-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:56:33.509-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:56:33.611-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:56:33.612-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:56:43.641-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:56:43.645-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:56:43.647-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:56:43.742-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:56:43.742-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:56:53.783-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:56:53.786-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:56:53.788-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:56:53.886-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:56:53.886-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:57:03.097-0500 W NETWORK [conn737] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:57:03.101-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:57:03.110-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:57:04.013-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:57:04.017-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:57:04.019-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:57:04.107-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:57:04.107-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:57:14.154-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:57:14.158-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:57:14.160-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:57:14.262-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:57:14.262-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:57:16.068-0500 W NETWORK [conn737] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:57:16.074-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:57:16.083-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:57:23.336-0500 W NETWORK [conn737] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:57:23.341-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:57:23.348-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:57:24.303-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:57:24.308-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:57:24.309-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:57:24.391-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:57:24.391-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:57:34.420-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:57:34.425-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:57:34.427-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:57:34.519-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:57:34.519-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:57:44.550-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:57:44.553-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:57:44.555-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:57:44.644-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:57:44.644-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:57:54.529-0500 W NETWORK [conn737] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:57:54.533-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:57:54.538-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:57:54.685-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:57:54.690-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:57:54.691-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:57:54.783-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:57:54.783-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:58:04.821-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:58:04.824-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:58:04.826-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:58:04.915-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:58:04.915-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:58:07.934-0500 W NETWORK [conn737] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:58:07.943-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:58:07.947-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:58:14.948-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:58:14.951-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:58:14.953-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:58:15.003-0500 I NETWORK [conn737] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:58:15.009-0500 I NETWORK [conn737] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:58:15.013-0500 I NETWORK [conn737] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:58:15.057-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:58:15.057-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:58:15.117-0500 W NETWORK [conn737] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:58:15.121-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:58:15.130-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:58:20.241-0500 W NETWORK [conn737] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:58:20.247-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:58:20.255-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:58:23.528-0500 W NETWORK [conn737] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:58:23.533-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:58:23.537-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:58:25.097-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:58:25.098-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:58:27.529-0500 W NETWORK [conn737] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:58:27.532-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:58:27.536-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:58:35.128-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:58:35.132-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:58:35.134-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:58:35.232-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:58:35.232-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:58:40.307-0500 W NETWORK [conn737] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:58:40.312-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:58:40.316-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:58:45.265-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:58:45.269-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:58:45.271-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:58:45.359-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:58:45.359-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:58:55.395-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:58:55.400-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:58:55.402-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:58:55.515-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:58:55.515-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:59:05.548-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:59:05.551-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:59:05.553-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:59:05.634-0500 I NETWORK [conn737] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:59:05.638-0500 I NETWORK [conn737] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:59:05.639-0500 I NETWORK [conn737] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:59:05.646-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:59:05.646-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:59:05.739-0500 W NETWORK [conn737] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:59:05.743-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:59:05.748-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:59:15.731-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:59:15.731-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:59:25.947-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:59:25.950-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:59:25.952-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:59:26.044-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:59:26.044-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:59:36.074-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:59:36.078-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:59:36.080-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:59:36.168-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:59:36.169-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:59:46.200-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:59:46.204-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:59:46.207-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:59:46.312-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:59:46.312-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T00:59:54.744-0500 W NETWORK [conn737] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T00:59:54.748-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T00:59:54.752-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T00:59:56.341-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T00:59:56.346-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T00:59:56.348-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T00:59:56.465-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T00:59:56.465-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:00:04.258-0500 W NETWORK [conn737] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:00:04.261-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:00:04.266-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:00:06.492-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:00:06.495-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:00:06.585-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:00:06.675-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:00:06.675-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:00:16.710-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:00:16.713-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:00:16.715-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:00:16.795-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:00:16.795-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:00:20.692-0500 W NETWORK [conn737] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:00:20.696-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:00:20.700-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:00:26.837-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:00:26.841-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:00:26.843-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:00:26.928-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:00:26.928-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:00:27.323-0500 W NETWORK [conn737] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:00:27.330-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:00:27.340-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:00:36.961-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:00:36.964-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:00:36.966-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:00:37.076-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:00:37.076-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:00:47.106-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:00:47.109-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:00:47.111-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:00:47.194-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:00:47.194-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:00:57.234-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:00:57.237-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:00:57.239-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:00:57.322-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:00:57.322-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:00:57.770-0500 W NETWORK [conn737] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:00:57.774-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:00:57.778-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:01:07.360-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:01:07.364-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:01:07.366-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:01:07.462-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:01:07.462-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:01:10.368-0500 W NETWORK [conn737] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:01:10.374-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:01:10.378-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:01:10.711-0500 W NETWORK [conn737] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:01:10.715-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:01:10.719-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:01:11.135-0500 W NETWORK [conn737] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:01:11.140-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:01:11.144-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:01:17.543-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:01:17.587-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:01:17.589-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:01:17.680-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:01:17.680-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:01:25.661-0500 W NETWORK [conn737] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:01:25.665-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:01:25.669-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:01:27.711-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:01:27.715-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:01:27.717-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:01:27.804-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:01:27.804-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:01:35.622-0500 W NETWORK [conn737] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:01:35.626-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:01:35.633-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:01:37.829-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:01:37.833-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:01:37.835-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:01:37.934-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:01:37.934-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:01:38.167-0500 W NETWORK [conn737] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:01:38.172-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:01:38.176-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:01:47.964-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:01:47.968-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:01:47.970-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:01:48.061-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:01:48.061-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:01:56.729-0500 W NETWORK [conn737] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:01:56.732-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:01:56.736-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:01:58.091-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:01:58.094-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:01:58.096-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:01:58.186-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:01:58.186-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:02:02.100-0500 W NETWORK [conn737] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:02:02.105-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:02:02.109-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:02:03.549-0500 W NETWORK [conn737] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:02:03.554-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:02:03.558-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:02:06.829-0500 W NETWORK [conn737] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:02:06.840-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:02:06.846-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:02:08.285-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:02:08.289-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:02:08.290-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:02:08.381-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:02:08.381-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:02:18.519-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:02:18.522-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:02:18.524-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:02:18.612-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:02:18.612-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:02:22.681-0500 W NETWORK [conn737] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:02:22.684-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:02:22.688-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:02:28.635-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:02:28.640-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:02:28.643-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:02:28.733-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:02:28.733-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:02:35.331-0500 W NETWORK [conn737] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:02:35.335-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:02:35.339-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:02:38.762-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:02:38.767-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:02:38.769-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:02:38.859-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:02:38.860-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:02:42.717-0500 W NETWORK [conn737] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:02:42.721-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:02:42.725-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:02:45.294-0500 W NETWORK [conn737] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:02:45.298-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:02:45.302-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:02:48.895-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:02:48.899-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:02:48.901-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:02:49.000-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:02:49.000-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:02:59.033-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:02:59.037-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:02:59.039-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:02:59.128-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:02:59.128-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:03:03.117-0500 W NETWORK [conn737] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:03:03.121-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:03:03.125-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:03:09.162-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:03:09.167-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:03:09.169-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:03:09.252-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:03:09.252-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:03:11.454-0500 W NETWORK [conn737] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:03:11.458-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:03:11.462-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:03:12.784-0500 W NETWORK [conn737] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:03:12.790-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:03:12.794-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:03:15.390-0500 W NETWORK [conn737] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:03:15.393-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:03:15.398-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:03:19.290-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:03:19.294-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:03:19.296-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:03:19.398-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:03:19.399-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:03:28.587-0500 W NETWORK [conn737] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:03:28.590-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:03:28.594-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:03:29.432-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:03:29.435-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:03:29.437-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:03:29.524-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:03:29.524-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:03:39.540-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:03:39.544-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:03:39.546-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:03:39.636-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:03:39.637-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:03:49.651-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:03:49.655-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:03:49.656-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:03:49.753-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:03:49.753-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:03:50.052-0500 W NETWORK [conn737] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:03:50.058-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:03:50.062-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:03:59.795-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:03:59.802-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:03:59.809-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:03:59.901-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:03:59.902-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:04:09.938-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:04:09.942-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:04:09.943-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:04:10.038-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:04:10.038-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:04:20.082-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:04:20.085-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:04:20.087-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:04:20.185-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:04:20.185-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:04:30.214-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:04:30.218-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:04:30.220-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:04:30.312-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:04:30.312-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:04:40.377-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:04:40.382-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:04:40.384-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:04:40.447-0500 I NETWORK [conn737] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:04:40.453-0500 I NETWORK [conn737] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:04:40.456-0500 I NETWORK [conn737] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:04:40.496-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:04:40.496-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:04:40.612-0500 W NETWORK [conn737] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:04:40.621-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:04:40.630-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:04:50.550-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:04:50.550-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:05:00.613-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:05:00.618-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:05:00.620-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:05:00.713-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:05:00.713-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:05:10.747-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:05:10.750-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:05:10.752-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:05:10.846-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:05:10.846-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:05:20.895-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:05:20.899-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:05:20.901-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:05:20.982-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:05:20.983-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:05:31.020-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:05:31.024-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:05:31.025-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:05:31.111-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:05:31.111-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:05:41.139-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:05:41.142-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:05:41.143-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:05:41.246-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:05:41.246-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:05:51.280-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:05:51.284-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:05:51.287-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:05:51.378-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:05:51.378-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:06:01.410-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:06:01.414-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:06:01.438-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:06:01.533-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:06:01.533-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:06:11.278-0500 W NETWORK [conn737] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:06:11.282-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:06:11.286-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:06:11.562-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:06:11.566-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:06:11.567-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:06:11.650-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:06:11.650-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:06:21.687-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:06:21.693-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:06:21.695-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:06:21.788-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:06:21.788-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:06:27.356-0500 W NETWORK [conn737] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:06:27.361-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:06:27.365-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:06:31.821-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:06:31.825-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:06:31.828-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:06:31.931-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:06:31.931-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:06:41.966-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:06:41.970-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:06:41.973-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:06:42.054-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:06:42.055-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:06:52.110-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:06:52.114-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:06:52.116-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:06:52.212-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:06:52.212-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:07:02.243-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:07:02.247-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:07:02.249-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:07:02.333-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:07:02.333-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:07:11.575-0500 W NETWORK [conn737] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:07:11.579-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:07:11.583-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:07:12.368-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:07:12.372-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:07:12.373-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:07:12.464-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:07:12.464-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:07:18.396-0500 W NETWORK [conn737] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:07:18.400-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:07:18.404-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:07:21.871-0500 I - [conn737] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:07:21.875-0500 I CONTROL [conn737] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:07:22.504-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:07:22.508-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:07:22.561-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:07:22.651-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:07:22.651-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:07:32.693-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:07:32.697-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:07:32.699-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:07:32.796-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:07:32.796-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:07:42.836-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:07:42.840-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:07:42.841-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:07:42.926-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:07:42.926-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:07:52.965-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:07:52.968-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:07:52.970-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:07:53.065-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:07:53.065-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:07:55.475-0500 W NETWORK [conn725] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:07:55.479-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:07:55.483-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:08:00.242-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:08:00.245-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:08:00.253-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:08:03.097-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:08:03.100-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:08:03.102-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:08:03.189-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:08:03.190-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:08:13.227-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:08:13.231-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:08:13.233-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:08:13.325-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:08:13.325-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:08:22.288-0500 W NETWORK [conn725] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:08:22.293-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:08:22.300-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:08:23.358-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:08:23.362-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:08:23.364-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:08:23.473-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:08:23.473-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:08:29.027-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:08:29.034-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:08:29.040-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:08:33.504-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:08:33.508-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:08:33.510-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:08:33.604-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:08:33.604-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:08:43.647-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:08:43.651-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:08:43.654-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:08:43.746-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:08:43.746-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:08:53.783-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:08:53.787-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:08:53.789-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:08:53.880-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:08:53.880-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:09:03.919-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:09:03.924-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:09:03.925-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:09:04.013-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:09:04.013-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:09:04.311-0500 W NETWORK [conn725] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:09:04.314-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:09:04.319-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:09:14.059-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:09:14.063-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:09:14.065-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:09:14.162-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:09:14.162-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:09:22.945-0500 W NETWORK [conn725] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:09:22.954-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:09:22.963-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:09:23.991-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:09:24.000-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:09:24.010-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:09:24.057-0500 W NETWORK [conn725] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:09:24.063-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:09:24.067-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:09:24.193-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:09:24.197-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:09:24.199-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:09:24.295-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:09:24.295-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:09:24.347-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:09:24.350-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:09:24.355-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:09:30.707-0500 W NETWORK [conn725] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:09:30.711-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:09:30.714-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:09:34.322-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:09:34.327-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:09:34.328-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:09:34.421-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:09:34.421-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:09:44.453-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:09:44.457-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:09:44.459-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:09:44.559-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:09:44.559-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:09:54.589-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:09:54.592-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:09:54.593-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:09:54.670-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:09:54.670-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:10:04.742-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:10:04.746-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:10:04.749-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:10:04.865-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:10:04.865-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:10:14.897-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:10:14.993-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:10:14.995-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:10:15.081-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:10:15.081-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:10:20.114-0500 W NETWORK [conn725] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:10:20.118-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:10:20.122-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:10:21.250-0500 W NETWORK [conn725] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:10:21.253-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:10:21.257-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:10:25.113-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:10:25.118-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:10:25.120-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:10:25.250-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:10:25.250-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:10:35.289-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:10:35.293-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:10:35.296-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:10:35.406-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:10:35.406-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:10:44.816-0500 W NETWORK [conn725] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:10:44.819-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:10:44.824-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:10:45.453-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:10:45.457-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:10:45.461-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:10:45.573-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:10:45.573-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:10:47.103-0500 W NETWORK [conn725] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:10:47.106-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:10:47.110-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:10:55.082-0500 W NETWORK [conn725] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:10:55.087-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:10:55.092-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:10:55.607-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:10:55.610-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:10:55.612-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:10:55.708-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:10:55.708-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:10:58.160-0500 W NETWORK [conn725] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:10:58.163-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:10:58.168-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:11:05.730-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:11:05.736-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:11:05.738-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:11:05.828-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:11:05.828-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:11:13.996-0500 W NETWORK [conn725] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:11:14.005-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:11:14.010-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:11:15.880-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:11:15.883-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:11:15.885-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:11:15.989-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:11:15.989-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:11:16.517-0500 W NETWORK [conn725] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:11:16.525-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:11:16.530-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:11:20.814-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:11:20.819-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:11:20.828-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:11:21.951-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:11:21.957-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:11:21.968-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:11:26.132-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:11:26.136-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:11:26.138-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:11:26.222-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:11:26.222-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:11:29.541-0500 W NETWORK [conn725] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:11:29.549-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:11:29.553-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:11:35.513-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:11:35.519-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:11:35.527-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:11:36.258-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:11:36.263-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:11:36.265-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:11:36.375-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:11:36.375-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:11:46.408-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:11:46.411-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:11:46.416-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:11:46.507-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:11:46.508-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:11:56.586-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:11:56.589-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:11:56.590-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:11:56.672-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:11:56.672-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:12:06.718-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:12:06.722-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:12:06.724-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:12:06.816-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:12:06.816-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:12:16.846-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:12:16.851-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:12:16.853-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:12:16.959-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:12:16.959-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:12:26.987-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:12:26.992-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:12:26.994-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:12:27.086-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:12:27.086-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:12:28.306-0500 W NETWORK [conn725] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:12:28.310-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:12:28.314-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:12:30.048-0500 W NETWORK [conn725] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:12:30.052-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:12:30.057-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:12:35.524-0500 W NETWORK [conn725] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:12:35.530-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:12:35.534-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:12:37.116-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:12:37.121-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:12:37.123-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:12:37.220-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:12:37.220-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:12:47.249-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:12:47.253-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:12:47.256-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:12:47.371-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:12:47.371-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:12:56.291-0500 W NETWORK [conn725] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:12:56.297-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:12:56.306-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:12:57.400-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:12:57.404-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:12:57.406-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:12:57.514-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:12:57.515-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:13:04.910-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:13:04.914-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:13:04.918-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:13:07.556-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:13:07.560-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:13:07.561-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:13:07.645-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:13:07.645-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:13:12.706-0500 W NETWORK [conn725] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:13:12.712-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:13:12.717-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:13:17.665-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:13:17.668-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:13:17.670-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:13:17.765-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:13:17.765-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:13:22.303-0500 W NETWORK [conn725] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:13:22.310-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:13:22.317-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:13:27.813-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:13:27.818-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:13:27.820-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:13:27.907-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:13:27.907-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:13:38.092-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:13:38.096-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:13:38.098-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:13:38.198-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:13:38.198-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:13:43.681-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:13:43.685-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:13:43.689-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:13:47.982-0500 W NETWORK [conn725] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:13:47.989-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:13:47.994-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:13:48.231-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:13:48.235-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:13:48.238-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:13:48.331-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:13:48.331-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:13:58.363-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:13:58.367-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:13:58.369-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:13:58.464-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:13:58.464-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:14:08.497-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:14:08.500-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:14:08.502-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:14:08.597-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:14:08.598-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:14:16.678-0500 W NETWORK [conn725] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:14:16.683-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:14:16.687-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:14:18.422-0500 W NETWORK [conn725] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:14:18.426-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:14:18.430-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:14:18.629-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:14:18.633-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:14:18.642-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:14:18.741-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:14:18.741-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:14:28.779-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:14:28.782-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:14:28.784-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:14:28.866-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:14:28.866-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:14:33.600-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:14:33.606-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:14:33.617-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:14:38.905-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:14:38.909-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:14:38.912-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:14:39.001-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:14:39.001-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:14:49.033-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:14:49.037-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:14:49.039-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:14:49.143-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:14:49.143-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:14:59.172-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:14:59.176-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:14:59.178-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:14:59.282-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:14:59.283-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:15:09.325-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:15:09.340-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:15:09.341-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:15:09.425-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:15:09.426-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:15:12.564-0500 W NETWORK [conn725] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:15:12.572-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:15:12.577-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:15:19.457-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:15:19.461-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:15:19.463-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:15:19.578-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:15:19.578-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:15:20.975-0500 W NETWORK [conn725] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:15:20.981-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:15:20.987-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:15:23.911-0500 W NETWORK [conn725] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:15:23.916-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:15:23.920-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:15:29.617-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:15:29.621-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:15:29.623-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:15:29.715-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:15:29.715-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:15:39.749-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:15:39.753-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:15:39.755-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:15:39.855-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:15:39.855-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:15:42.278-0500 W NETWORK [conn725] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:15:42.282-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:15:42.287-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:15:49.892-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:15:49.896-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:15:49.899-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:15:49.994-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:15:49.995-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:16:00.034-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:16:00.038-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:16:00.040-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:16:00.136-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:16:00.136-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:16:00.564-0500 W NETWORK [conn725] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:16:00.568-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:16:00.580-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:16:03.856-0500 W NETWORK [conn725] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:16:03.861-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:16:03.866-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:16:10.177-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:16:10.180-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:16:10.182-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:16:10.283-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:16:10.283-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:16:13.226-0500 W NETWORK [conn725] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:16:13.230-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:16:13.236-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:16:20.323-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:16:20.327-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:16:20.330-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:16:20.430-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:16:20.431-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:16:22.231-0500 W NETWORK [conn725] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:16:22.234-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:16:22.238-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:16:30.455-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:16:30.460-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:16:30.462-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:16:30.564-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:16:30.564-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:16:40.629-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:16:40.641-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:16:40.648-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:16:40.728-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:16:40.729-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:16:50.764-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:16:50.767-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:16:50.769-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:16:50.854-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:16:50.854-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:17:00.894-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:17:00.898-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:17:00.899-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:17:00.999-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:17:00.999-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:17:01.553-0500 W NETWORK [conn725] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:17:01.556-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:17:01.560-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:17:11.049-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:17:11.054-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:17:11.056-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:17:11.142-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:17:11.142-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:17:14.114-0500 W NETWORK [conn725] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:17:14.120-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:17:14.124-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:17:21.180-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:17:21.184-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:17:21.185-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:17:21.281-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:17:21.281-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:17:23.933-0500 W NETWORK [conn725] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:17:23.940-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:17:23.945-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:17:31.356-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:17:31.359-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:17:31.360-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:17:31.458-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:17:31.458-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:17:34.388-0500 W NETWORK [conn725] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:17:34.392-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:17:34.396-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:17:41.033-0500 W NETWORK [conn725] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:17:41.037-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:17:41.041-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:17:41.494-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:17:41.498-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:17:41.500-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:17:41.607-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:17:41.607-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:17:46.477-0500 W NETWORK [conn725] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:17:46.483-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:17:46.494-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:17:51.652-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:17:51.656-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:17:51.658-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:17:51.753-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:17:51.753-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:18:01.796-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:18:01.799-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:18:01.801-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:18:01.895-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:18:01.896-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:18:11.938-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:18:11.943-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:18:11.945-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:18:12.049-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:18:12.050-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:18:22.087-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:18:22.090-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:18:22.092-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:18:22.180-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:18:22.180-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:18:32.215-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:18:32.218-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:18:32.221-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:18:32.320-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:18:32.320-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:18:42.458-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:18:42.462-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:18:42.464-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:18:42.568-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:18:42.569-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:18:51.063-0500 W NETWORK [conn725] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:18:51.068-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:18:51.072-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:18:52.602-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:18:52.605-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:18:52.608-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:18:52.711-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:18:52.711-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:19:02.725-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:19:02.729-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:19:02.731-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:19:02.822-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:19:02.822-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:19:07.150-0500 W NETWORK [conn725] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:19:07.156-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:19:07.162-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:19:12.838-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:19:12.841-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:19:12.844-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:19:12.940-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:19:12.940-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:19:14.696-0500 W NETWORK [conn725] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:19:14.700-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:19:14.704-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:19:22.955-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:19:22.960-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:19:22.964-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:19:23.064-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:19:23.064-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:19:33.104-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:19:33.108-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:19:33.110-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:19:33.212-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:19:33.212-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:19:43.303-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:19:43.307-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:19:43.309-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:19:43.394-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:19:43.394-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:19:53.473-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:19:53.478-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:19:53.479-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:19:53.591-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:19:53.591-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:20:03.624-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:20:03.627-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:20:03.630-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:20:03.727-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:20:03.728-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:20:13.775-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:20:13.778-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:20:13.781-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:20:13.875-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:20:13.875-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:20:23.910-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:20:23.914-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:20:23.917-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:20:24.019-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:20:24.019-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:20:34.048-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:20:34.052-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:20:34.054-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:20:34.144-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:20:34.144-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:20:44.173-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:20:44.177-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:20:44.179-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:20:44.281-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:20:44.281-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:20:47.849-0500 W NETWORK [conn725] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:20:47.853-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:20:47.857-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:20:50.554-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:20:50.558-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:20:50.562-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:20:52.299-0500 W NETWORK [conn725] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:20:52.306-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:20:52.314-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:20:54.296-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:20:54.300-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:20:54.302-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:20:54.397-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:20:54.398-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:21:00.831-0500 W NETWORK [conn725] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:21:00.836-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:21:00.841-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:21:04.415-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:21:04.419-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:21:04.420-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:21:04.518-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:21:04.518-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:21:04.522-0500 I NETWORK [conn725] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:21:04.525-0500 I NETWORK [conn725] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:21:04.527-0500 I NETWORK [conn725] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:21:04.616-0500 W NETWORK [conn725] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:21:04.620-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:21:04.625-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:21:14.567-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:21:14.567-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:21:24.601-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:21:24.605-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:21:24.607-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:21:24.701-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:21:24.701-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:21:29.124-0500 W NETWORK [conn725] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:21:29.127-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:21:29.134-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:21:34.742-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:21:34.746-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:21:34.749-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:21:34.848-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:21:34.849-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:21:44.876-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:21:44.879-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:21:44.881-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:21:44.982-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:21:44.982-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:21:55.003-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:21:55.008-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:21:55.012-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:21:55.123-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:21:55.123-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:22:05.159-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:22:05.163-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:22:05.165-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:22:05.260-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:22:05.261-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:22:07.964-0500 W NETWORK [conn725] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:22:07.970-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:22:07.979-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:22:15.295-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:22:15.395-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:22:15.402-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:22:15.504-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:22:15.504-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:22:23.258-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:22:23.262-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:22:23.266-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:22:25.520-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:22:25.524-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:22:25.526-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:22:25.622-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:22:25.622-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:22:35.762-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:22:35.766-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:22:35.768-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:22:35.880-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:22:35.880-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:22:39.239-0500 W NETWORK [conn725] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:22:39.243-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:22:39.247-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:22:45.955-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:22:45.959-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:22:45.961-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:22:46.058-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:22:46.059-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:22:52.128-0500 W NETWORK [conn725] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:22:52.132-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:22:52.135-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:22:52.699-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:22:52.703-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:22:52.708-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:22:56.097-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:22:56.101-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:22:56.106-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:22:56.207-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:22:56.208-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:23:06.247-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:23:06.251-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:23:06.253-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:23:06.372-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:23:06.372-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:23:07.915-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:23:07.918-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:23:07.922-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:23:16.495-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:23:16.499-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:23:16.501-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:23:16.617-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:23:16.617-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:23:26.656-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:23:26.660-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:23:26.661-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:23:26.741-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:23:26.741-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:23:28.399-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:23:28.404-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:23:28.408-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:23:29.527-0500 W NETWORK [conn725] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:23:29.533-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:23:29.537-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:23:30.798-0500 W NETWORK [conn725] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:23:30.803-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:23:30.807-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:23:36.777-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:23:36.781-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:23:36.784-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:23:36.879-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:23:36.879-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:23:46.915-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:23:46.918-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:23:46.920-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:23:47.025-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:23:47.025-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:23:57.076-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:23:57.081-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:23:57.083-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:23:57.181-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:23:57.181-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:23:57.756-0500 W NETWORK [conn725] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:23:57.760-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:23:57.764-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:24:01.554-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:24:01.557-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:24:01.562-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:24:02.029-0500 W NETWORK [conn725] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:24:02.033-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:24:02.039-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:24:07.210-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:24:07.214-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:24:07.216-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:24:07.318-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:24:07.318-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:24:17.350-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:24:17.354-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:24:17.357-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:24:17.447-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:24:17.447-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:24:21.300-0500 W NETWORK [conn725] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:24:21.303-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:24:21.307-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:24:23.892-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:24:23.897-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:24:23.902-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:24:27.480-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:24:27.485-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:24:27.488-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:24:27.583-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:24:27.583-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:24:34.270-0500 W NETWORK [conn725] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:24:34.274-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:24:34.278-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:24:37.614-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:24:37.618-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:24:37.662-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:24:37.760-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:24:37.761-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:24:47.236-0500 W NETWORK [conn725] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:24:47.241-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:24:47.245-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:24:47.791-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:24:47.794-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:24:47.797-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:24:47.877-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:24:47.877-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:24:50.382-0500 W NETWORK [conn725] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:24:50.385-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:24:50.389-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:24:52.458-0500 W NETWORK [conn725] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:24:52.462-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:24:52.466-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:24:57.987-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:24:57.992-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:24:57.994-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:24:58.100-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:24:58.100-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:25:08.134-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:25:08.139-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:25:08.141-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:25:08.223-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:25:08.223-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:25:09.282-0500 W NETWORK [conn725] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:25:09.288-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:25:09.293-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:25:09.694-0500 W NETWORK [conn725] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:25:09.698-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:25:09.702-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:25:16.895-0500 W NETWORK [conn725] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:25:16.898-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:25:16.902-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:25:18.257-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:25:18.261-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:25:18.263-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:25:18.369-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:25:18.369-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:25:28.400-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:25:28.404-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:25:28.406-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:25:28.499-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:25:28.499-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:25:38.539-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:25:38.543-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:25:38.550-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:25:38.643-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:25:38.643-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:25:48.680-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:25:48.684-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:25:48.685-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:25:48.790-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:25:48.790-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:25:51.551-0500 W NETWORK [conn725] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:25:51.555-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:25:51.559-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:25:58.813-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:25:58.818-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:25:58.820-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:25:58.919-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:25:58.920-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:26:00.290-0500 W NETWORK [conn725] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:26:00.294-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:26:00.298-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:26:04.745-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:26:04.749-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:26:04.754-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:26:08.941-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:26:08.945-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:26:08.947-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:26:09.040-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:26:09.040-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:26:19.069-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:26:19.074-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:26:19.076-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:26:19.167-0500 I NETWORK [conn725] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:26:19.168-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:26:19.168-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:26:19.171-0500 I NETWORK [conn725] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:26:19.172-0500 I NETWORK [conn725] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:26:19.252-0500 W NETWORK [conn725] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:26:19.257-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:26:19.261-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:26:21.515-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:26:21.519-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:26:21.523-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:26:29.215-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:26:29.215-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:26:39.258-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:26:39.261-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:26:39.263-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:26:39.391-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:26:39.391-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:26:49.427-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:26:49.431-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:26:49.433-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:26:49.528-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:26:49.528-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:26:52.182-0500 W NETWORK [conn725] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:26:52.187-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:26:52.191-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:26:59.556-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:26:59.561-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:26:59.564-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:26:59.671-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:26:59.671-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:27:09.791-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:27:09.795-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:27:09.797-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:27:09.901-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:27:09.901-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:27:19.971-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:27:20.082-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:27:20.085-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:27:20.189-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:27:20.189-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:27:30.221-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:27:30.225-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:27:30.227-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:27:30.324-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:27:30.324-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:27:40.352-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:27:40.356-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:27:40.358-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:27:40.467-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:27:40.468-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:27:50.498-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:27:50.502-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:27:50.503-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:27:50.595-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:27:50.595-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:27:56.700-0500 W NETWORK [conn725] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:27:56.704-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:27:56.710-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:28:00.634-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:28:00.638-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:28:00.640-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:28:00.739-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:28:00.740-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:28:03.118-0500 W NETWORK [conn725] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:03.122-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:28:03.126-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:28:03.154-0500 W NETWORK [conn725] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:03.262-0500 W NETWORK [conn725] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:03.265-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:28:03.269-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:28:04.147-0500 W NETWORK [conn725] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:04.155-0500 I - [conn725] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:28:04.159-0500 I CONTROL [conn725] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:28:04.457-0500 W NETWORK [conn737] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:05.716-0500 W NETWORK [conn727] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:06.089-0500 W NETWORK [conn727] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:06.434-0500 W NETWORK [conn737] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:07.029-0500 W NETWORK [conn738] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:07.067-0500 W NETWORK [conn738] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:07.815-0500 W NETWORK [conn738] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:07.819-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:28:07.823-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:28:07.894-0500 W NETWORK [conn738] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:07.897-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:28:07.901-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:28:08.002-0500 W NETWORK [conn738] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:08.006-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:28:08.012-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:28:08.048-0500 W NETWORK [conn738] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:08.052-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:28:08.055-0500 W NETWORK [conn738] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:08.056-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:28:08.058-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:28:08.062-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:28:08.228-0500 W NETWORK [conn738] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:08.335-0500 W NETWORK [conn738] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:08.465-0500 W NETWORK [conn738] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:08.716-0500 W NETWORK [conn727] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:08.740-0500 W NETWORK [conn727] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:08.824-0500 W NETWORK [conn726] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:08.876-0500 W NETWORK [conn727] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:09.114-0500 W NETWORK [conn727] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:09.134-0500 W NETWORK [conn727] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:09.208-0500 W NETWORK [conn727] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:09.225-0500 W NETWORK [conn727] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:09.325-0500 W NETWORK [conn727] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:09.497-0500 W NETWORK [conn727] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:09.608-0500 W NETWORK [conn736] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:09.612-0500 I - [conn736] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:28:09.616-0500 I CONTROL [conn736] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:28:09.636-0500 W NETWORK [conn736] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:09.642-0500 I - [conn736] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:28:09.644-0500 W NETWORK [conn727] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:09.648-0500 I CONTROL [conn736] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:28:09.697-0500 W NETWORK [conn736] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:09.775-0500 W NETWORK [conn727] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:09.828-0500 W NETWORK [conn737] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:09.905-0500 W NETWORK [conn737] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:09.990-0500 W NETWORK [conn737] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:09.994-0500 W NETWORK [conn736] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:10.277-0500 W NETWORK [conn736] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:10.281-0500 I NETWORK [conn737] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:28:10.284-0500 I NETWORK [conn737] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:28:10.284-0500 W NETWORK [conn736] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:10.286-0500 I NETWORK [conn737] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:28:10.377-0500 W NETWORK [conn737] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:10.447-0500 W NETWORK [conn727] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:10.564-0500 W NETWORK [conn727] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:10.578-0500 W NETWORK [conn737] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:10.743-0500 W NETWORK [conn736] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:10.800-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:28:10.801-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:28:10.853-0500 W NETWORK [conn727] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:10.893-0500 W NETWORK [conn727] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:10.896-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:28:10.904-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:28:10.944-0500 W NETWORK [conn736] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:10.984-0500 I NETWORK [conn738] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:28:10.987-0500 W NETWORK [conn727] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:10.991-0500 I NETWORK [conn738] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:28:10.993-0500 I NETWORK [conn738] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:28:11.023-0500 I NETWORK [conn736] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:28:11.023-0500 W NETWORK [conn727] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:11.028-0500 I NETWORK [conn736] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:28:11.030-0500 I NETWORK [conn736] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:28:11.098-0500 W NETWORK [conn738] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:11.102-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:28:11.106-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:28:11.120-0500 W NETWORK [conn736] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:11.235-0500 W NETWORK [conn727] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:11.239-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:28:11.243-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:28:11.390-0500 W NETWORK [conn736] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:11.526-0500 W NETWORK [conn736] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:11.605-0500 W NETWORK [conn736] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:11.678-0500 W NETWORK [conn736] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:11.683-0500 W NETWORK [conn736] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:11.755-0500 W NETWORK [conn736] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:11.768-0500 W NETWORK [conn727] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:11.969-0500 W NETWORK [conn738] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:12.020-0500 W NETWORK [conn736] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:12.040-0500 W NETWORK [conn727] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:12.114-0500 W NETWORK [conn736] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:12.155-0500 W NETWORK [conn736] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:12.162-0500 W NETWORK [conn763] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:12.208-0500 W NETWORK [conn738] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:12.548-0500 W NETWORK [conn738] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:12.558-0500 W NETWORK [conn736] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:12.575-0500 W NETWORK [conn727] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:12.578-0500 W NETWORK [conn763] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:12.635-0500 W NETWORK [conn763] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:12.715-0500 W NETWORK [conn738] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:12.719-0500 W NETWORK [conn738] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:12.829-0500 W NETWORK [conn763] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:13.046-0500 W NETWORK [conn763] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:13.100-0500 W NETWORK [conn763] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:13.119-0500 W NETWORK [conn763] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:13.126-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:28:13.130-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:28:13.236-0500 W NETWORK [conn763] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:13.246-0500 W NETWORK [conn738] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:13.466-0500 W NETWORK [conn738] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:13.474-0500 W NETWORK [conn738] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:13.505-0500 W NETWORK [conn738] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:13.535-0500 W NETWORK [conn738] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:13.563-0500 W NETWORK [conn738] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:13.611-0500 W NETWORK [conn738] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:13.641-0500 W NETWORK [conn738] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:13.689-0500 W NETWORK [conn738] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:13.834-0500 W NETWORK [conn763] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:13.930-0500 W NETWORK [conn738] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:13.937-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:28:13.938-0500 W NETWORK [conn763] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:13.939-0500 W NETWORK [conn738] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:13.941-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:28:14.072-0500 W NETWORK [conn738] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:14.094-0500 W NETWORK [conn763] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:14.146-0500 W NETWORK [conn738] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:14.158-0500 W NETWORK [conn763] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:14.158-0500 W NETWORK [conn738] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:14.239-0500 W NETWORK [conn763] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:14.298-0500 W NETWORK [conn738] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:14.305-0500 W NETWORK [conn727] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:14.320-0500 W NETWORK [conn738] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:14.333-0500 W NETWORK [conn738] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:14.404-0500 W NETWORK [conn738] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:14.447-0500 W NETWORK [conn738] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:14.453-0500 W NETWORK [conn738] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:14.530-0500 W NETWORK [conn738] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:14.533-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:28:14.537-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:28:14.545-0500 W NETWORK [conn738] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:14.569-0500 W NETWORK [conn727] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:14.570-0500 W NETWORK [conn738] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:14.575-0500 W NETWORK [conn738] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:14.597-0500 W NETWORK [conn727] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:14.624-0500 W NETWORK [conn738] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:14.658-0500 W NETWORK [conn727] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:14.663-0500 W NETWORK [conn727] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:14.707-0500 W NETWORK [conn727] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:14.733-0500 W NETWORK [conn727] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:14.785-0500 W NETWORK [conn727] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:14.814-0500 W NETWORK [conn727] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:14.826-0500 W NETWORK [conn727] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:14.874-0500 W NETWORK [conn727] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:14.875-0500 W NETWORK [conn738] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:14.881-0500 W NETWORK [conn763] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:14.901-0500 W NETWORK [conn763] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:14.946-0500 W NETWORK [conn763] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:14.957-0500 W NETWORK [conn763] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:14.973-0500 W NETWORK [conn763] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:14.975-0500 W NETWORK [conn738] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:14.979-0500 W NETWORK [conn738] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:14.995-0500 W NETWORK [conn738] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:15.000-0500 W NETWORK [conn738] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:15.066-0500 W NETWORK [conn763] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:15.135-0500 W NETWORK [conn763] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:15.245-0500 W NETWORK [conn727] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:15.262-0500 W NETWORK [conn727] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:15.263-0500 W NETWORK [conn738] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:15.356-0500 W NETWORK [conn763] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:15.393-0500 W NETWORK [conn763] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:15.417-0500 W NETWORK [conn763] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:15.419-0500 W NETWORK [conn727] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:15.425-0500 W NETWORK [conn727] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:15.446-0500 W NETWORK [conn763] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:15.446-0500 W NETWORK [conn727] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:15.461-0500 W NETWORK [conn763] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:15.476-0500 W NETWORK [conn763] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:15.506-0500 W NETWORK [conn763] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:15.506-0500 W NETWORK [conn727] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:15.545-0500 W NETWORK [conn727] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:15.553-0500 W NETWORK [conn763] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:15.678-0500 W NETWORK [conn727] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:15.722-0500 W NETWORK [conn738] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:15.735-0500 W NETWORK [conn738] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:15.743-0500 W NETWORK [conn738] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:15.778-0500 W NETWORK [conn763] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:15.802-0500 W NETWORK [conn763] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:15.806-0500 I - [conn763] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:28:15.810-0500 I CONTROL [conn763] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:28:15.833-0500 W NETWORK [conn763] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:15.846-0500 W NETWORK [conn763] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:15.847-0500 W NETWORK [conn736] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:15.853-0500 W NETWORK [conn736] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:15.883-0500 W NETWORK [conn736] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:15.892-0500 W NETWORK [conn763] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:16.043-0500 W NETWORK [conn738] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:16.048-0500 W NETWORK [conn738] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:16.065-0500 W NETWORK [conn738] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:16.276-0500 W NETWORK [conn763] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:16.288-0500 W NETWORK [conn763] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:16.321-0500 W NETWORK [conn763] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:16.428-0500 W NETWORK [conn763] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:16.483-0500 W NETWORK [conn763] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:16.517-0500 W NETWORK [conn763] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:16.571-0500 W NETWORK [conn763] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:16.596-0500 W NETWORK [conn738] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:16.607-0500 W NETWORK [conn763] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:16.665-0500 W NETWORK [conn763] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:16.752-0500 W NETWORK [conn727] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:16.785-0500 W NETWORK [conn727] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:16.798-0500 W NETWORK [conn738] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:16.810-0500 W NETWORK [conn738] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:16.849-0500 W NETWORK [conn727] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:16.868-0500 W NETWORK [conn727] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:16.874-0500 W NETWORK [conn727] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:16.881-0500 W NETWORK [conn727] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:16.881-0500 W NETWORK [conn738] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:16.906-0500 W NETWORK [conn738] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:16.933-0500 W NETWORK [conn738] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:16.987-0500 W NETWORK [conn727] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:17.040-0500 W NETWORK [conn727] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:17.068-0500 W NETWORK [conn727] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:17.084-0500 W NETWORK [conn727] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:17.091-0500 W NETWORK [conn727] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:17.104-0500 W NETWORK [conn727] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:17.142-0500 W NETWORK [conn727] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:17.168-0500 W NETWORK [conn727] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:17.235-0500 W NETWORK [conn738] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:17.244-0500 W NETWORK [conn738] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:17.269-0500 W NETWORK [conn738] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:17.281-0500 W NETWORK [conn727] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:17.321-0500 W NETWORK [conn738] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:17.414-0500 W NETWORK [conn727] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:17.414-0500 W NETWORK [conn738] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:17.449-0500 W NETWORK [conn727] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:17.477-0500 W NETWORK [conn727] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:17.520-0500 W NETWORK [conn738] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:17.526-0500 W NETWORK [conn738] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:17.565-0500 W NETWORK [conn763] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:17.570-0500 W NETWORK [conn763] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:17.636-0500 W NETWORK [conn763] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:17.670-0500 W NETWORK [conn763] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:17.708-0500 W NETWORK [conn763] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:17.734-0500 W NETWORK [conn763] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:17.790-0500 W NETWORK [conn727] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:17.887-0500 W NETWORK [conn763] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:17.900-0500 W NETWORK [conn763] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:17.904-0500 W NETWORK [conn763] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:18.004-0500 W NETWORK [conn727] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:18.032-0500 W NETWORK [conn763] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:18.219-0500 W NETWORK [conn763] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:18.223-0500 W NETWORK [conn727] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:18.437-0500 W NETWORK [conn738] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:18.454-0500 W NETWORK [conn736] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:18.461-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:28:18.470-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:28:18.503-0500 W NETWORK [conn736] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:18.550-0500 W NETWORK [conn727] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:18.583-0500 W NETWORK [conn763] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:18.646-0500 W NETWORK [conn763] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:18.647-0500 W NETWORK [conn727] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:18.745-0500 W NETWORK [conn738] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:18.807-0500 W NETWORK [conn727] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:18.880-0500 W NETWORK [conn727] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:18.888-0500 W NETWORK [conn727] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:18.912-0500 W NETWORK [conn727] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:19.102-0500 W NETWORK [conn763] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:19.344-0500 W NETWORK [conn727] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:19.631-0500 W NETWORK [conn727] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:19.737-0500 W NETWORK [conn738] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:19.840-0500 W NETWORK [conn727] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:21.013-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:28:21.014-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:28:25.349-0500 W NETWORK [conn738] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:28:25.352-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:28:25.356-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:28:31.050-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:28:31.050-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:28:41.097-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:28:41.100-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:28:41.101-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:28:41.207-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:28:41.207-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:28:51.236-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:28:51.240-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:28:51.245-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:28:51.340-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:28:51.340-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:29:01.370-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:29:01.373-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:29:01.378-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:29:01.476-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:29:01.476-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:29:07.080-0500 W NETWORK [conn738] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:29:07.087-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:29:07.091-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:29:11.510-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:29:11.513-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:29:11.543-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:29:11.640-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:29:11.640-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:29:18.657-0500 W NETWORK [conn738] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:29:18.660-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:29:18.665-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:29:21.668-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:29:21.671-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:29:21.673-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:29:21.780-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:29:21.780-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:29:31.796-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:29:31.800-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:29:31.801-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:29:31.899-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:29:31.899-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:29:41.916-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:29:41.921-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:29:41.923-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:29:42.010-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:29:42.010-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:29:47.883-0500 W NETWORK [conn738] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:29:47.888-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:29:47.892-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:29:52.032-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:29:52.036-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:29:52.038-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:29:52.123-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:29:52.123-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:30:02.164-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:30:02.173-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:30:02.175-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:30:02.318-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:30:02.319-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:30:07.084-0500 W NETWORK [conn738] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:30:07.088-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:30:07.092-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:30:09.974-0500 W NETWORK [conn738] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:30:09.978-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:30:09.983-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:30:12.358-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:30:12.362-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:30:12.364-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:30:12.455-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:30:12.455-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:30:20.441-0500 W NETWORK [conn738] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:30:20.447-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:30:20.453-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:30:21.784-0500 W NETWORK [conn738] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:30:21.788-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:30:21.794-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:30:22.515-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:30:22.518-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:30:22.520-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:30:22.611-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:30:22.611-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:30:32.642-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:30:32.647-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:30:32.649-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:30:32.744-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:30:32.744-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:30:33.690-0500 W NETWORK [conn738] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:30:33.694-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:30:33.698-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:30:42.774-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:30:42.778-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:30:42.782-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:30:42.887-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:30:42.887-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:30:43.694-0500 W NETWORK [conn738] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:30:43.697-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:30:43.702-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:30:52.915-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:30:52.920-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:30:52.922-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:30:53.022-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:30:53.022-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:31:00.862-0500 W NETWORK [conn738] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:31:00.868-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:31:00.877-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:31:01.965-0500 W NETWORK [conn727] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:31:01.969-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:31:01.975-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:31:03.053-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:31:03.056-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:31:03.057-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:31:03.162-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:31:03.162-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:31:13.195-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:31:13.199-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:31:13.202-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:31:13.294-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:31:13.294-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:31:23.430-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:31:23.434-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:31:23.469-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:31:23.559-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:31:23.559-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:31:33.610-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:31:33.613-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:31:33.615-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:31:33.717-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:31:33.717-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:31:36.079-0500 W NETWORK [conn727] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:31:36.167-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:31:36.172-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:31:43.757-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:31:43.761-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:31:43.763-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:31:43.854-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:31:43.854-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:31:50.262-0500 W NETWORK [conn727] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:31:50.271-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:31:50.280-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:31:53.889-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:31:53.894-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:31:53.897-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:31:53.985-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:31:53.985-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:32:04.150-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:32:04.153-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:32:04.155-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:32:04.245-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:32:04.245-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:32:14.280-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:32:14.283-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:32:14.285-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:32:14.375-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:32:14.375-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:32:16.351-0500 W NETWORK [conn727] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:32:16.355-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:32:16.360-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:32:24.408-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:32:24.411-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:32:24.413-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:32:24.502-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:32:24.502-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:32:34.583-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:32:34.587-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:32:34.589-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:32:34.672-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:32:34.672-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:32:37.931-0500 W NETWORK [conn727] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:32:37.936-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:32:37.940-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:32:44.707-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:32:44.711-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:32:44.713-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:32:44.790-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:32:44.790-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:32:54.821-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:32:54.824-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:32:54.825-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:32:54.916-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:32:54.916-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:33:04.980-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:33:04.983-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:33:04.986-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:33:05.073-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:33:05.074-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:33:06.443-0500 W NETWORK [conn727] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:33:06.448-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:33:06.452-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:33:15.105-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:33:15.109-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:33:15.111-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:33:15.189-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:33:15.190-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:33:25.224-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:33:25.230-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:33:25.233-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:33:25.342-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:33:25.343-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:33:35.373-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:33:35.377-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:33:35.380-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:33:35.473-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:33:35.474-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:33:45.512-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:33:45.516-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:33:45.518-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:33:45.615-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:33:45.615-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:33:55.646-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:33:55.649-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:33:55.651-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:33:55.764-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:33:55.764-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:34:03.700-0500 W NETWORK [conn727] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:34:03.703-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:34:03.708-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:34:05.800-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:34:05.803-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:34:05.805-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:34:05.899-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:34:05.899-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:34:15.931-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:34:15.935-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:34:15.938-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:34:16.035-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:34:16.035-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:34:18.014-0500 W NETWORK [conn727] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:34:18.018-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:34:18.024-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:34:26.065-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:34:26.069-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:34:26.070-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:34:26.178-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:34:26.178-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:34:36.292-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:34:36.296-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:34:36.298-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:34:36.393-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:34:36.394-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:34:46.427-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:34:46.430-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:34:46.433-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:34:46.529-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:34:46.529-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:34:50.357-0500 W NETWORK [conn727] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:34:50.363-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:34:50.367-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:34:56.545-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:34:56.549-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:34:56.551-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:34:56.641-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:34:56.641-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:35:06.664-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:35:06.668-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:35:06.669-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:35:06.750-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:35:06.750-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:35:11.407-0500 W NETWORK [conn727] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:35:11.411-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:35:11.415-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:35:16.781-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:35:16.785-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:35:16.787-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:35:16.892-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:35:16.893-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:35:25.088-0500 W NETWORK [conn727] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:35:25.091-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:35:25.096-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:35:27.054-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:35:27.058-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:35:27.060-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:35:27.161-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:35:27.161-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:35:37.195-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:35:37.200-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:35:37.202-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:35:37.309-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:35:37.309-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:35:42.665-0500 W NETWORK [conn727] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:35:42.668-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:35:42.672-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:35:47.341-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:35:47.346-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:35:47.348-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:35:47.435-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:35:47.435-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:35:57.464-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:35:57.468-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:35:57.470-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:35:57.599-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:35:57.599-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:36:01.889-0500 W NETWORK [conn727] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:36:01.892-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:36:01.896-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:36:05.522-0500 W NETWORK [conn727] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:36:05.529-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:36:05.540-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:36:05.907-0500 W NETWORK [conn727] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:36:05.910-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:36:05.914-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:36:07.630-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:36:07.634-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:36:07.635-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:36:07.727-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:36:07.727-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:36:10.100-0500 W NETWORK [conn727] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:36:10.104-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:36:10.109-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:36:13.274-0500 W NETWORK [conn727] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:36:13.277-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:36:13.281-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:36:16.547-0500 W NETWORK [conn727] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:36:16.550-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:36:16.554-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:36:17.755-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:36:17.759-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:36:17.762-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:36:17.850-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:36:17.850-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:36:27.889-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:36:27.893-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:36:27.896-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:36:28.001-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:36:28.002-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:36:37.703-0500 W NETWORK [conn727] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:36:37.707-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:36:37.712-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:36:38.046-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:36:38.051-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:36:38.053-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:36:38.167-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:36:38.168-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:36:48.278-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:36:48.281-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:36:48.283-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:36:48.381-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:36:48.382-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:36:51.375-0500 W NETWORK [conn727] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:36:51.378-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:36:51.384-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:36:51.624-0500 W NETWORK [conn727] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:36:51.628-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:36:51.632-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:36:58.496-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:36:58.500-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:36:58.502-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:36:58.598-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:36:58.598-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:37:06.089-0500 W NETWORK [conn727] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:37:06.093-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:37:06.102-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:37:07.265-0500 W NETWORK [conn727] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:37:07.268-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:37:07.273-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:37:08.026-0500 W NETWORK [conn727] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:37:08.033-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:37:08.042-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:37:08.632-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:37:08.639-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:37:08.643-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:37:08.737-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:37:08.737-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:37:18.769-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:37:18.773-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:37:18.775-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:37:18.863-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:37:18.863-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:37:28.893-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:37:28.897-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:37:28.901-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:37:29.016-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:37:29.016-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:37:39.048-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:37:39.053-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:37:39.055-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:37:39.162-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:37:39.162-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:37:49.203-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:37:49.208-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:37:49.211-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:37:49.309-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:37:49.310-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:37:59.354-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:37:59.360-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:37:59.362-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:37:59.470-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:37:59.470-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:38:00.741-0500 W NETWORK [conn727] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:38:00.745-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:38:00.749-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:38:01.169-0500 W NETWORK [conn727] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:38:01.173-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:38:01.177-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:38:09.506-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:38:09.510-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:38:09.514-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:38:09.614-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:38:09.614-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:38:19.656-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:38:19.660-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:38:19.662-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:38:19.766-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:38:19.766-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:38:29.801-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:38:29.805-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:38:29.807-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:38:29.898-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:38:29.898-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:38:39.933-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:38:39.937-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:38:39.938-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:38:40.030-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:38:40.030-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:38:50.096-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:38:50.100-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:38:50.102-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:38:50.219-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:38:50.219-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:38:54.680-0500 W NETWORK [conn727] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:38:54.686-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:38:54.695-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:38:58.476-0500 W NETWORK [conn727] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:38:58.480-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:38:58.484-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:39:00.275-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:39:00.279-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:39:00.281-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:39:00.384-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:39:00.384-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:39:02.431-0500 W NETWORK [conn727] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:39:02.434-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:39:02.438-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:39:06.037-0500 W NETWORK [conn727] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:39:06.044-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:39:06.055-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:39:10.413-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:39:10.416-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:39:10.418-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:39:10.510-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:39:10.510-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:39:19.788-0500 W NETWORK [conn727] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:39:19.796-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:39:19.806-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:39:20.588-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:39:20.592-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:39:20.595-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:39:20.702-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:39:20.703-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:39:30.734-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:39:30.738-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:39:30.740-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:39:30.854-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:39:30.854-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:39:40.870-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:39:40.874-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:39:40.875-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:39:40.960-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:39:40.960-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:39:50.991-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:39:50.995-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:39:50.997-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:39:51.088-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:39:51.088-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:40:01.134-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:40:01.256-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:40:01.357-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:40:01.441-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:40:01.441-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:40:11.486-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:40:11.490-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:40:11.492-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:40:11.586-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:40:11.586-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:40:21.623-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:40:21.627-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:40:21.628-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:40:21.717-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:40:21.717-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:40:31.811-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:40:31.816-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:40:31.818-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:40:31.928-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:40:31.928-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:40:42.152-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:40:42.156-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:40:42.159-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:40:42.271-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:40:42.271-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:40:42.580-0500 W NETWORK [conn727] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:40:42.584-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:40:42.588-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:40:52.299-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:40:52.303-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:40:52.304-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:40:52.397-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:40:52.397-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:40:54.394-0500 W NETWORK [conn727] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:40:54.400-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:40:54.410-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:41:02.429-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:41:02.433-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:41:02.434-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:41:02.524-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:41:02.524-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:41:12.552-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:41:12.556-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:41:12.558-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:41:12.649-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:41:12.649-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:41:22.686-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:41:22.690-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:41:22.693-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:41:22.789-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:41:22.789-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:41:32.820-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:41:32.824-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:41:32.826-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:41:32.924-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:41:32.924-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:41:43.034-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:41:43.042-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:41:43.047-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:41:43.142-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:41:43.142-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:41:53.172-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:41:53.175-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:41:53.178-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:41:53.294-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:41:53.294-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:42:03.324-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:42:03.329-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:42:03.330-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:42:03.453-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:42:03.453-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:42:09.161-0500 W NETWORK [conn727] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:42:09.166-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:42:09.171-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:42:13.489-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:42:13.492-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:42:13.494-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:42:13.589-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:42:13.589-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:42:23.661-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:42:23.664-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:42:23.666-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:42:23.759-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:42:23.760-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:42:33.791-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:42:33.794-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:42:33.796-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:42:33.933-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:42:33.933-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:42:37.474-0500 W NETWORK [conn727] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:42:37.478-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:42:37.482-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:42:38.802-0500 W NETWORK [conn727] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:42:38.805-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:42:38.810-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:42:43.961-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:42:43.965-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:42:43.966-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:42:44.055-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:42:44.055-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:42:54.086-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:42:54.089-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:42:54.091-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:42:54.176-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:42:54.177-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:43:04.206-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:43:04.210-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:43:04.211-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:43:04.312-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:43:04.312-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:43:14.328-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:43:14.332-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:43:14.334-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:43:14.431-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:43:14.434-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:43:14.435-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:43:14.438-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:43:14.438-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:43:24.465-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:43:24.465-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:43:34.495-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:43:34.499-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:43:34.501-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:43:34.592-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:43:34.592-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:43:41.997-0500 W NETWORK [conn727] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:43:42.001-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:43:42.009-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:43:44.627-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:43:44.632-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:43:44.634-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:43:44.716-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:43:44.716-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:43:54.784-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:43:54.789-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:43:54.791-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:43:54.890-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:43:54.890-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:44:04.237-0500 W NETWORK [conn727] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:44:04.243-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:44:04.252-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:44:04.920-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:44:04.924-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:44:04.926-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:44:05.059-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:44:05.059-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:44:15.094-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:44:15.098-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:44:15.100-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:44:15.197-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:44:15.197-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:44:25.231-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:44:25.235-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:44:25.237-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:44:25.333-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:44:25.334-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:44:35.381-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:44:35.386-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:44:35.388-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:44:35.483-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:44:35.483-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:44:45.499-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:44:45.503-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:44:45.506-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:44:45.618-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:44:45.619-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:44:55.654-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:44:55.657-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:44:55.659-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:44:55.752-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:44:55.752-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:45:01.575-0500 W NETWORK [conn727] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:45:01.579-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:45:01.583-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:45:05.790-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:45:05.794-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:45:05.797-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:45:05.908-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:45:05.908-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:45:15.967-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:45:15.971-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:45:15.973-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:45:16.073-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:45:16.073-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:45:22.065-0500 W NETWORK [conn727] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:45:22.069-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:45:22.075-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:45:23.865-0500 W NETWORK [conn727] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:45:23.868-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:45:23.873-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:45:26.109-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:45:26.113-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:45:26.115-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:45:26.228-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:45:26.228-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:45:36.263-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:45:36.267-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:45:36.269-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:45:36.365-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:45:36.365-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:45:45.124-0500 W NETWORK [conn727] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:45:45.128-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:45:45.132-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:45:46.412-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:45:46.415-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:45:46.417-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:45:46.525-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:45:46.529-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:45:56.565-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:45:56.568-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:45:56.571-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:45:56.673-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:45:56.673-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:46:06.714-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:46:06.718-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:46:06.720-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:46:06.813-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:46:06.813-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:46:16.850-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:46:16.855-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:46:16.856-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:46:16.977-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:46:16.977-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:46:19.418-0500 W NETWORK [conn727] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:46:19.430-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:46:19.434-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:46:24.130-0500 W NETWORK [conn727] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:46:24.134-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:46:24.138-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:46:27.034-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:46:27.038-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:46:27.040-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:46:27.128-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:46:27.129-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:46:27.750-0500 W NETWORK [conn727] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:46:27.754-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:46:27.761-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:46:37.169-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:46:37.174-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:46:37.176-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:46:37.270-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:46:37.271-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:46:44.838-0500 W NETWORK [conn727] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:46:44.844-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:46:44.852-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:46:47.322-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:46:47.325-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:46:47.328-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:46:47.415-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:46:47.416-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:46:57.440-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:46:57.444-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:46:57.445-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:46:57.541-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:46:57.541-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:46:59.814-0500 W NETWORK [conn727] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:46:59.818-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:46:59.823-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:47:06.630-0500 W NETWORK [conn727] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:47:06.635-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:47:06.639-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:47:07.559-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:47:07.563-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:47:07.565-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:47:07.665-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:47:07.667-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:47:17.682-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:47:17.687-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:47:17.691-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:47:17.782-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:47:17.782-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:47:27.819-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:47:27.823-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:47:27.825-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:47:27.917-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:47:27.917-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:47:28.512-0500 W NETWORK [conn727] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:47:28.517-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:47:28.522-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:47:37.969-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:47:37.973-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:47:37.975-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:47:38.073-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:47:38.073-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:47:48.109-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:47:48.112-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:47:48.159-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:47:48.266-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:47:48.266-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:47:54.787-0500 W NETWORK [conn727] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:47:54.790-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:47:54.796-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:47:57.132-0500 W NETWORK [conn727] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:47:57.139-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:47:57.143-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:47:58.295-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:47:58.299-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:47:58.300-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:47:58.399-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:47:58.399-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:48:08.579-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:48:08.583-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:48:08.585-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:48:08.697-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:48:08.697-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:48:18.726-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:48:18.730-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:48:18.733-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:48:18.830-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:48:18.831-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:48:28.862-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:48:28.866-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:48:28.869-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:48:28.950-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:48:28.950-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:48:38.981-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:48:38.986-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:48:38.988-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:48:39.090-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:48:39.091-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:48:49.126-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:48:49.131-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:48:49.133-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:48:49.229-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:48:49.229-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:48:59.262-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:48:59.267-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:48:59.269-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:48:59.382-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:48:59.382-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:49:09.408-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:49:09.413-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:49:09.415-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:49:09.510-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:49:09.510-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:49:19.540-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:49:19.544-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:49:19.546-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:49:19.633-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:49:19.633-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:49:26.969-0500 W NETWORK [conn727] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:49:26.972-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:49:26.976-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:49:28.948-0500 W NETWORK [conn727] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:49:28.957-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:49:28.965-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:49:29.673-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:49:29.677-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:49:29.679-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:49:29.779-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:49:29.780-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:49:39.816-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:49:39.820-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:49:39.822-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:49:39.930-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:49:39.930-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:49:50.020-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:49:50.024-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:49:50.085-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:49:50.192-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:49:50.192-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:50:00.228-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:50:00.231-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:50:00.233-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:50:00.332-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:50:00.332-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:50:10.371-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:50:10.375-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:50:10.377-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:50:10.476-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:50:10.476-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:50:20.512-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:50:20.518-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:50:20.520-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:50:20.611-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:50:20.611-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:50:27.914-0500 W NETWORK [conn727] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:50:27.920-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:50:27.929-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:50:30.649-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:50:30.653-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:50:30.655-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:50:30.756-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:50:30.756-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:50:40.788-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:50:40.791-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:50:40.793-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:50:40.877-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:50:40.877-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:50:50.992-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:50:50.995-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:50:50.997-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:50:51.096-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:50:51.096-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:50:54.970-0500 W NETWORK [conn727] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:50:54.974-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:50:54.978-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:51:01.122-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:51:01.136-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:51:01.138-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:51:01.225-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:51:01.225-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:51:06.445-0500 W NETWORK [conn727] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:51:06.450-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:51:06.454-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:51:11.254-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:51:11.258-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:51:11.259-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:51:11.351-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:51:11.351-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:51:21.404-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:51:21.408-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:51:21.485-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:51:21.586-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:51:21.586-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:51:28.737-0500 W NETWORK [conn727] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:51:28.741-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:51:28.748-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:51:31.607-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:51:31.611-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:51:31.613-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:51:31.707-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:51:31.707-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:51:41.727-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:51:41.730-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:51:41.733-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:51:41.816-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:51:41.816-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:51:51.005-0500 W NETWORK [conn727] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:51:51.009-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:51:51.014-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:51:51.855-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:51:51.858-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:51:51.860-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:51:52.012-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:51:52.012-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:52:02.089-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:52:02.093-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:52:02.094-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:52:02.174-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:52:02.174-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:52:12.211-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:52:12.214-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:52:12.216-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:52:12.308-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:52:12.308-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:52:22.402-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:52:22.415-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:52:22.416-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:52:22.510-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:52:22.510-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:52:32.546-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:52:32.550-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:52:32.552-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:52:32.643-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:52:32.643-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:52:33.824-0500 W NETWORK [conn727] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:52:33.827-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:52:33.831-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:52:42.680-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:52:42.684-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:52:42.686-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:52:42.771-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:52:42.771-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:52:52.808-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:52:52.811-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:52:52.813-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:52:52.908-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:52:52.908-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:53:02.957-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:53:02.961-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:53:02.962-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:53:03.054-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:53:03.054-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:53:05.470-0500 W NETWORK [conn727] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:53:05.474-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:53:05.478-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:53:13.095-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:53:13.099-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:53:13.101-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:53:13.217-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:53:13.217-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:53:23.249-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:53:23.252-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:53:23.254-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:53:23.335-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:53:23.336-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:53:24.686-0500 W NETWORK [conn727] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:53:24.690-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:53:24.697-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:53:25.730-0500 W NETWORK [conn727] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:53:25.733-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:53:25.737-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:53:33.372-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:53:33.375-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:53:33.377-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:53:33.486-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:53:33.486-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:53:35.531-0500 W NETWORK [conn727] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:53:35.534-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:53:35.539-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:53:43.526-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:53:43.529-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:53:43.531-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:53:43.621-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:53:43.621-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:53:49.107-0500 W NETWORK [conn727] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:53:49.112-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:53:49.117-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:53:53.655-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:53:53.660-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:53:53.663-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:53:53.764-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:53:53.764-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:54:00.489-0500 W NETWORK [conn727] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:54:00.494-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:54:00.499-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:54:03.799-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:54:03.995-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:54:03.997-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:54:04.099-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:54:04.100-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:54:14.123-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:54:14.126-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:54:14.128-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:54:14.217-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:54:14.218-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:54:24.237-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:54:24.240-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:54:24.242-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:54:24.328-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:54:24.328-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:54:26.119-0500 W NETWORK [conn727] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:54:26.124-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:54:26.133-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:54:34.362-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:54:34.366-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:54:34.368-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:54:34.465-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:54:34.465-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:54:44.501-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:54:44.504-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:54:44.506-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:54:44.594-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:54:44.594-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:54:54.630-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:54:54.635-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:54:54.638-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:54:54.748-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:54:54.748-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:55:00.028-0500 W NETWORK [conn727] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:55:00.033-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:55:00.038-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:55:02.855-0500 W NETWORK [conn727] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:55:02.859-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:55:02.865-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:55:04.847-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:55:04.850-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:55:04.852-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:55:04.947-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:55:04.947-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:55:15.005-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:55:15.011-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:55:15.013-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:55:15.113-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:55:15.113-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:55:25.144-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:55:25.148-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:55:25.150-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:55:25.252-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:55:25.252-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:55:35.279-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:55:35.283-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:55:35.286-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:55:35.384-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:55:35.385-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:55:37.590-0500 W NETWORK [conn727] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:55:37.594-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:55:37.598-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:55:38.415-0500 W NETWORK [conn727] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:55:38.419-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:55:38.423-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:55:45.415-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:55:45.419-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:55:45.427-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:55:45.537-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:55:45.537-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:55:51.130-0500 W NETWORK [conn727] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:55:51.136-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:55:51.145-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:55:55.619-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:55:55.623-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:55:55.624-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:55:55.715-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:55:55.715-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:56:00.737-0500 W NETWORK [conn727] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:56:00.741-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:56:00.750-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:56:05.749-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:56:05.754-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:56:05.756-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:56:05.840-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:56:05.840-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:56:15.876-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:56:15.879-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:56:15.881-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:56:15.979-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:56:15.980-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:56:17.715-0500 W NETWORK [conn727] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:56:17.719-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:56:17.724-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:56:26.010-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:56:26.013-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:56:26.015-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:56:26.108-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:56:26.108-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:56:36.193-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:56:36.196-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:56:36.198-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:56:36.283-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:56:36.283-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:56:37.866-0500 W NETWORK [conn727] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:56:37.870-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:56:37.874-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:56:39.188-0500 W NETWORK [conn727] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:56:39.193-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:56:39.199-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:56:46.314-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:56:46.318-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:56:46.320-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:56:46.416-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:56:46.416-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:56:56.453-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:56:56.457-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:56:56.460-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:56:56.562-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:56:56.562-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:57:06.578-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:57:06.581-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:57:06.587-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:57:06.676-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:57:06.676-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:57:16.111-0500 W NETWORK [conn727] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:57:16.114-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:57:16.118-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:57:16.702-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:57:16.707-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:57:16.710-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:57:16.811-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:57:16.811-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:57:16.977-0500 W NETWORK [conn727] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:57:16.980-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:57:16.984-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:57:21.320-0500 W NETWORK [conn727] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:57:21.324-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:57:21.330-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:57:26.852-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:57:26.856-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:57:26.857-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:57:26.970-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:57:26.970-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:57:27.915-0500 W NETWORK [conn727] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:57:27.920-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:57:27.926-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:57:35.354-0500 W NETWORK [conn727] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:57:35.358-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:57:35.362-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:57:36.291-0500 W NETWORK [conn727] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:57:36.294-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:57:36.299-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:57:37.008-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:57:37.013-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:57:37.015-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:57:37.118-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:57:37.118-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:57:47.146-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:57:47.149-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:57:47.152-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:57:47.250-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:57:47.250-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:57:57.292-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:57:57.296-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:57:57.298-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:57:57.394-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:57:57.394-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:58:07.424-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:58:07.430-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:58:07.432-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:58:07.526-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:58:07.526-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:58:17.563-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:58:17.566-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:58:17.568-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:58:17.658-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:58:17.659-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:58:27.705-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:58:27.709-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:58:27.710-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:58:27.795-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:58:27.795-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:58:37.825-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:58:37.828-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:58:37.831-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:58:37.937-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:58:37.937-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:58:47.968-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:58:47.972-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:58:47.974-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:58:48.075-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:58:48.077-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:58:58.107-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:58:58.112-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:58:58.114-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:58:58.213-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:58:58.213-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:59:08.366-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:59:08.370-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:59:08.372-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:59:08.465-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:59:08.466-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:59:18.499-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:59:18.503-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:59:18.505-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:59:18.594-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:59:18.594-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:59:28.622-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:59:28.627-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:59:28.628-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:59:28.716-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:59:28.716-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:59:38.747-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:59:38.751-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:59:38.760-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:59:38.873-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:59:38.873-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:59:49.110-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:59:49.115-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:59:49.117-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:59:49.217-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:59:49.217-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T01:59:52.688-0500 W NETWORK [conn727] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T01:59:52.692-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T01:59:52.696-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T01:59:59.287-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T01:59:59.292-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T01:59:59.295-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T01:59:59.381-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T01:59:59.381-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:00:05.118-0500 W NETWORK [conn727] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:00:05.123-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:00:05.130-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:00:09.472-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:00:09.476-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:00:09.477-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:00:09.577-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:00:09.577-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:00:19.601-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:00:19.605-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:00:19.607-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:00:19.703-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:00:19.703-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:00:29.735-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:00:29.740-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:00:29.743-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:00:29.857-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:00:29.857-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:00:38.297-0500 W NETWORK [conn727] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:00:38.303-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:00:38.309-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:00:39.893-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:00:39.897-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:00:39.899-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:00:39.988-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:00:39.989-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:00:50.131-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:00:50.135-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:00:50.137-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:00:50.249-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:00:50.249-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:00:53.114-0500 W NETWORK [conn727] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:00:53.117-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:00:53.121-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:01:00.297-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:01:00.301-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:01:00.304-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:01:00.390-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:01:00.390-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:01:02.869-0500 W NETWORK [conn727] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:01:02.872-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:01:02.876-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:01:10.423-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:01:10.427-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:01:10.429-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:01:10.518-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:01:10.518-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:01:10.834-0500 W NETWORK [conn727] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:01:10.837-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:01:10.841-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:01:13.982-0500 W NETWORK [conn727] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:01:13.987-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:01:13.991-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:01:20.571-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:01:20.575-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:01:20.577-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:01:20.668-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:01:20.669-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:01:29.953-0500 W NETWORK [conn727] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:01:29.956-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:01:29.960-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:01:30.706-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:01:30.821-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:01:30.823-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:01:30.915-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:01:30.916-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:01:33.117-0500 W NETWORK [conn727] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:01:33.123-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:01:33.132-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:01:40.985-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:01:40.989-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:01:40.991-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:01:41.090-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:01:41.090-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:01:47.504-0500 W NETWORK [conn727] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:01:47.508-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:01:47.512-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:01:47.974-0500 W NETWORK [conn727] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:01:47.977-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:01:47.981-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:01:49.937-0500 W NETWORK [conn727] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:01:49.941-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:01:49.945-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:01:50.555-0500 W NETWORK [conn727] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:01:50.558-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:01:50.562-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:01:51.183-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:01:51.188-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:01:51.190-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:01:51.299-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:01:51.299-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:01:52.377-0500 W NETWORK [conn727] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:01:52.381-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:01:52.385-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:01:53.826-0500 W NETWORK [conn727] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:01:53.834-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:01:53.841-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:02:01.333-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:02:01.337-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:02:01.339-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:02:01.429-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:02:01.429-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:02:11.470-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:02:11.474-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:02:11.475-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:02:11.567-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:02:11.570-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:02:21.593-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:02:21.597-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:02:21.599-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:02:21.694-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:02:21.694-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:02:31.327-0500 W NETWORK [conn727] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:02:31.331-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:02:31.335-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:02:31.718-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:02:31.722-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:02:31.725-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:02:31.826-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:02:31.826-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:02:33.752-0500 W NETWORK [conn727] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:02:33.756-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:02:33.760-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:02:34.876-0500 W NETWORK [conn727] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:02:34.880-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:02:34.885-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:02:41.861-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:02:41.865-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:02:41.868-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:02:41.965-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:02:41.965-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:02:51.997-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:02:52.001-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:02:52.003-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:02:52.111-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:02:52.111-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:03:00.709-0500 W NETWORK [conn727] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:03:00.715-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:03:00.720-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:03:02.146-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:03:02.150-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:03:02.152-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:03:02.239-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:03:02.239-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:03:06.619-0500 W NETWORK [conn727] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:03:06.623-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:03:06.629-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:03:12.276-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:03:12.280-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:03:12.284-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:03:12.384-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:03:12.385-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:03:12.436-0500 W NETWORK [conn727] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:03:12.439-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:03:12.444-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:03:15.562-0500 W NETWORK [conn727] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:03:15.566-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:03:15.569-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:03:20.862-0500 W NETWORK [conn727] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:03:20.870-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:03:20.881-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:03:22.439-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:03:22.444-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:03:22.447-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:03:22.551-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:03:22.551-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:03:23.565-0500 W NETWORK [conn727] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:03:23.569-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:03:23.575-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:03:24.369-0500 W NETWORK [conn727] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:03:24.372-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:03:24.377-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:03:25.325-0500 W NETWORK [conn727] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:03:25.329-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:03:25.333-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:03:32.589-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:03:32.593-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:03:32.595-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:03:32.695-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:03:32.695-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:03:42.729-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:03:42.733-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:03:42.736-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:03:42.829-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:03:42.829-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:03:43.439-0500 W NETWORK [conn727] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:03:43.447-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:03:43.454-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:03:49.347-0500 W NETWORK [conn727] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:03:49.351-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:03:49.355-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:03:49.581-0500 W NETWORK [conn727] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:03:49.585-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:03:49.591-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:03:51.197-0500 W NETWORK [conn727] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:03:51.202-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:03:51.211-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:03:52.886-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:03:52.890-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:03:52.892-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:03:52.995-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:03:52.996-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:03:53.946-0500 W NETWORK [conn727] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:03:53.957-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:03:53.964-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:03:54.119-0500 W NETWORK [conn727] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:03:54.126-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:03:54.137-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:04:03.035-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:04:03.041-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:04:03.044-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:04:03.158-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:04:03.158-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:04:09.905-0500 W NETWORK [conn727] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:04:09.910-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:04:09.915-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:04:13.186-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:04:13.191-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:04:13.193-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:04:13.290-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:04:13.291-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:04:18.036-0500 W NETWORK [conn727] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:04:18.040-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:04:18.044-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:04:23.323-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:04:23.460-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:04:23.532-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:04:23.685-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:04:23.685-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:04:30.898-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:04:30.905-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:04:33.700-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:04:33.704-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:04:33.706-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:04:33.793-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:04:33.793-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:04:38.108-0500 W NETWORK [conn727] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:04:38.112-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:04:38.116-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:04:43.812-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:04:43.815-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:04:43.817-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:04:43.916-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:04:43.916-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:04:54.000-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:04:54.004-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:04:54.005-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:04:54.088-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:04:54.088-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:05:04.159-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:05:04.188-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:05:04.217-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:05:04.323-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:05:04.323-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:05:10.821-0500 W NETWORK [conn727] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:05:10.827-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:05:10.834-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:05:12.614-0500 W NETWORK [conn727] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:05:12.619-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:05:12.624-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:05:14.364-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:05:14.369-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:05:14.371-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:05:14.438-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:05:14.442-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:05:14.443-0500 I NETWORK [UserCacheInvalidator] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:05:14.472-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:05:14.473-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:05:24.510-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:05:24.510-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:05:34.540-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:05:34.544-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:05:34.546-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:05:34.644-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:05:34.644-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:05:44.681-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:05:44.684-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:05:44.686-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:05:44.777-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:05:44.777-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:05:53.031-0500 W NETWORK [conn727] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:05:53.039-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:05:53.048-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:05:54.796-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:05:54.799-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:05:54.802-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:05:54.890-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:05:54.890-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:06:05.079-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:06:05.087-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:06:05.094-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:06:05.185-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:06:05.185-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:06:05.419-0500 W NETWORK [conn727] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:06:05.424-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:06:05.431-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:06:07.913-0500 W NETWORK [conn727] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:06:07.916-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:06:07.920-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:06:11.703-0500 W NETWORK [conn727] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:06:11.707-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:06:11.712-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:06:15.246-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:06:15.250-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:06:15.263-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:06:15.370-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:06:15.370-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:06:17.727-0500 W NETWORK [conn727] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:06:17.731-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:06:17.735-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:06:24.871-0500 W NETWORK [conn727] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:06:24.911-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:06:24.919-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:06:25.400-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:06:25.404-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:06:25.405-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:06:25.494-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:06:25.494-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:06:35.588-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:06:35.593-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:06:35.594-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:06:35.699-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:06:35.699-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:06:45.774-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:06:45.777-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:06:45.779-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:06:45.879-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:06:45.879-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:06:51.286-0500 W NETWORK [conn727] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:06:51.290-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:06:51.294-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:06:55.916-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:06:55.921-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:06:55.924-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:06:56.020-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:06:56.020-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:07:05.661-0500 W NETWORK [conn727] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:07:05.666-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:07:05.670-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:07:06.056-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:07:06.060-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:07:06.062-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:07:06.183-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:07:06.183-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:07:16.224-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:07:16.228-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:07:16.231-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:07:16.325-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:07:16.325-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:07:26.362-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:07:26.366-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:07:26.369-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:07:26.475-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:07:26.475-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:07:33.538-0500 W NETWORK [conn727] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:07:33.544-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:07:33.551-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:07:36.533-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:07:36.537-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:07:36.539-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:07:36.659-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:07:36.659-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:07:46.692-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:07:46.696-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:07:46.698-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:07:46.800-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:07:46.800-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:07:52.180-0500 W NETWORK [conn727] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:07:52.184-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:07:52.188-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:07:56.864-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:07:56.868-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:07:56.870-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:07:56.969-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:07:56.969-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:07:58.330-0500 W NETWORK [conn727] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:07:58.334-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:07:58.338-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:08:01.856-0500 W NETWORK [conn727] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:08:01.861-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:08:01.866-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:08:06.533-0500 W NETWORK [conn727] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:08:06.537-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:08:06.542-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:08:07.008-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:08:07.012-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:08:07.015-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:08:07.098-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:08:07.099-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:08:17.133-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:08:17.137-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:08:17.139-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:08:17.234-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:08:17.234-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:08:27.269-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:08:27.273-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:08:27.275-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:08:27.380-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:08:27.380-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:08:37.418-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:08:37.421-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:08:37.422-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:08:37.510-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:08:37.510-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:08:39.779-0500 W NETWORK [conn738] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:08:39.785-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:08:39.790-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:08:43.348-0500 W NETWORK [conn738] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:08:43.352-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:08:43.356-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:08:47.547-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:08:47.551-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:08:47.553-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:08:47.663-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:08:47.664-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:08:55.259-0500 W NETWORK [conn738] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:08:55.262-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:08:55.267-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:08:57.708-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:08:57.711-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:08:57.713-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:08:57.813-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:08:57.813-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:08:59.221-0500 W NETWORK [conn738] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:08:59.227-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:08:59.236-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:09:05.045-0500 W NETWORK [conn738] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:09:05.051-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:09:05.056-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:09:07.851-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:09:07.856-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:09:07.858-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:09:07.949-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:09:07.949-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:09:10.339-0500 W NETWORK [conn738] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:09:10.345-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:09:10.353-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:09:13.070-0500 W NETWORK [conn738] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:09:13.073-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:09:13.077-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:09:17.987-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:09:17.991-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:09:17.993-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:09:18.094-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:09:18.094-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:09:28.258-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:09:28.262-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:09:28.264-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:09:28.352-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:09:28.352-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:09:29.607-0500 W NETWORK [conn738] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:09:29.611-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:09:29.616-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:09:31.039-0500 W NETWORK [conn738] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:09:31.042-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:09:31.046-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:09:38.381-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:09:38.385-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:09:38.387-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:09:38.452-0500 I NETWORK [conn738] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:09:38.457-0500 I NETWORK [conn738] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:09:38.459-0500 I NETWORK [conn738] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:09:38.473-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:09:38.473-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:09:38.547-0500 W NETWORK [conn738] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:09:38.551-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:09:38.556-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:09:48.507-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:09:48.507-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:09:58.543-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:09:58.548-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:09:58.551-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:09:58.641-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:09:58.642-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:10:08.677-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:10:08.680-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:10:08.682-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:10:08.767-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:10:08.767-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:10:13.733-0500 W NETWORK [conn738] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:10:13.739-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:10:13.743-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:10:18.817-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:10:18.822-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:10:18.857-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:10:18.886-0500 I NETWORK [conn738] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:10:18.891-0500 I NETWORK [conn738] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:10:18.893-0500 I NETWORK [conn738] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:10:18.957-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:10:18.957-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:10:18.983-0500 W NETWORK [conn738] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:10:18.987-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:10:18.991-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:10:20.724-0500 W NETWORK [conn738] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:10:20.728-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:10:20.732-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:10:26.201-0500 W NETWORK [conn738] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:10:26.205-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:10:26.209-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:10:28.992-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:10:28.993-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:10:39.044-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:10:39.047-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:10:39.049-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:10:39.139-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:10:39.140-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:10:45.860-0500 W NETWORK [conn738] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:10:45.864-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:10:45.869-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:10:49.233-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:10:49.238-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:10:49.239-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:10:49.339-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:10:49.339-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:10:59.379-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:10:59.382-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:10:59.384-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:10:59.490-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:10:59.490-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:11:09.521-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:11:09.524-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:11:09.526-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:11:09.632-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:11:09.632-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:11:19.665-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:11:19.670-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:11:19.672-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:11:19.763-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:11:19.763-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:11:24.650-0500 W NETWORK [conn738] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:11:24.655-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:11:24.662-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:11:29.793-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:11:29.796-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:11:29.798-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:11:29.887-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:11:29.887-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:11:35.635-0500 W NETWORK [conn738] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:11:35.639-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:11:35.644-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:11:39.917-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:11:39.922-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:11:39.924-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:11:40.024-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:11:40.025-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:11:50.056-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:11:50.062-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:11:50.063-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:11:50.155-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:11:50.155-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:11:58.093-0500 W NETWORK [conn738] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:11:58.100-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:11:58.104-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:11:59.683-0500 W NETWORK [conn738] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:11:59.687-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:11:59.691-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:12:00.196-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:12:00.199-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:12:00.201-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:12:00.289-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:12:00.289-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:12:10.561-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:12:10.564-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:12:10.566-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:12:10.650-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:12:10.650-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:12:20.701-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:12:20.704-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:12:20.707-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:12:20.793-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:12:20.793-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:12:30.824-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:12:30.827-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:12:30.829-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:12:30.929-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:12:30.929-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:12:40.963-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:12:40.966-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:12:40.969-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:12:41.067-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:12:41.068-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:12:50.648-0500 W NETWORK [conn738] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:12:50.656-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:12:50.669-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:12:51.083-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:12:51.087-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:12:51.090-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:12:51.179-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:12:51.179-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:13:01.231-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:13:01.235-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:13:01.237-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:13:01.338-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:13:01.338-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:13:05.445-0500 W NETWORK [conn738] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:13:05.449-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:13:05.453-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:13:11.378-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:13:11.382-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:13:11.383-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:13:11.486-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:13:11.486-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:13:21.522-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:13:21.525-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:13:21.527-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:13:21.610-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:13:21.610-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:13:21.655-0500 W NETWORK [conn738] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:13:21.660-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:13:21.665-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:13:31.647-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:13:31.652-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:13:31.654-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:13:31.763-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:13:31.763-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:13:35.881-0500 W NETWORK [conn738] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:13:35.885-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:13:35.891-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:13:41.812-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:13:41.816-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:13:41.820-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:13:41.908-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:13:41.908-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:13:51.966-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:13:51.970-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:13:51.972-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:13:52.070-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:13:52.070-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:13:59.336-0500 W NETWORK [conn738] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:13:59.341-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:13:59.350-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:14:02.106-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:14:02.111-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:14:02.112-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:14:02.197-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:14:02.198-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:14:05.674-0500 W NETWORK [conn738] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:14:05.678-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:14:05.682-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:14:12.234-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:14:12.238-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:14:12.239-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:14:12.331-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:14:12.331-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:14:22.368-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:14:22.371-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:14:22.373-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:14:22.465-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:14:22.465-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:14:26.410-0500 W NETWORK [conn738] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:14:26.413-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:14:26.420-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:14:29.108-0500 W NETWORK [conn738] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:14:29.111-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:14:29.116-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:14:32.501-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:14:32.598-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:14:32.600-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:14:32.723-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:14:32.723-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:14:34.351-0500 W NETWORK [conn738] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:14:34.355-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:14:34.359-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:14:39.701-0500 W NETWORK [conn738] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:14:39.708-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:14:39.721-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:14:42.758-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:14:42.761-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:14:42.763-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:14:42.849-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:14:42.849-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:14:45.591-0500 W NETWORK [conn738] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:14:45.598-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:14:45.607-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:14:52.896-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:14:52.901-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:14:52.903-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:14:52.993-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:14:52.993-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:15:01.172-0500 W NETWORK [conn738] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:15:01.176-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:15:01.180-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:15:02.700-0500 W NETWORK [conn738] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:15:02.703-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:15:02.708-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:15:03.030-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:15:03.034-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:15:03.036-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:15:03.131-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:15:03.132-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:15:03.497-0500 W NETWORK [conn738] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:15:03.502-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:15:03.506-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:15:10.421-0500 W NETWORK [conn738] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:15:10.427-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:15:10.433-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:15:13.207-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:15:13.211-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:15:13.213-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:15:13.305-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:15:13.305-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:15:23.346-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:15:23.350-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:15:23.351-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:15:23.444-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:15:23.444-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:15:33.502-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:15:33.505-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:15:33.507-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:15:33.604-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:15:33.604-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:15:39.844-0500 W NETWORK [conn738] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:15:39.848-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:15:39.852-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:15:43.637-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:15:43.641-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:15:43.644-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:15:43.741-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:15:43.741-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:15:45.269-0500 W NETWORK [conn738] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:15:45.273-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:15:45.279-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:15:47.316-0500 W NETWORK [conn738] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:15:47.320-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:15:47.324-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:15:53.586-0500 W NETWORK [conn738] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:15:53.590-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:15:53.594-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:15:53.797-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:15:53.801-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:15:53.802-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:15:53.889-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:15:53.889-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:15:59.151-0500 W NETWORK [conn738] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:15:59.155-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:15:59.159-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:16:03.931-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:16:03.935-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:16:03.937-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:16:04.041-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:16:04.041-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:16:14.078-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:16:14.082-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:16:14.083-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:16:14.184-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:16:14.184-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:16:15.570-0500 W NETWORK [conn738] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:16:15.574-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:16:15.579-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:16:20.114-0500 W NETWORK [conn738] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:16:20.117-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:16:20.121-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:16:24.226-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:16:24.230-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:16:24.232-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:16:24.331-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:16:24.331-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:16:34.355-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:16:34.359-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:16:34.361-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:16:34.470-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:16:34.470-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:16:38.185-0500 W NETWORK [conn738] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:16:38.188-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:16:38.194-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:16:42.137-0500 W NETWORK [conn738] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:16:42.143-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:16:42.147-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:16:43.043-0500 W NETWORK [conn738] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:16:43.047-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:16:43.053-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:16:44.510-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:16:44.516-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:16:44.521-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:16:44.622-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:16:44.622-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:16:47.675-0500 W NETWORK [conn738] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:16:47.679-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:16:47.684-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:16:54.654-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:16:54.659-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:16:54.662-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:16:54.762-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:16:54.762-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:16:56.905-0500 W NETWORK [conn738] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:16:56.911-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:16:56.916-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:17:03.607-0500 W NETWORK [conn738] db exception when initializing on TT-RS13:TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS13/tdb-a13.white.xxx.com:4308,tdb-m13.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:17:03.611-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:17:03.615-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:17:04.793-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:17:04.797-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:17:04.799-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:17:04.901-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:17:04.902-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:17:12.644-0500 W NETWORK [conn738] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:17:12.648-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:17:12.652-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:17:14.946-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:17:14.950-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:17:14.951-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:17:15.041-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:17:15.041-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:17:16.286-0500 W NETWORK [conn738] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:17:16.290-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:17:16.294-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:17:22.480-0500 W NETWORK [conn738] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:17:22.485-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:17:22.492-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:17:25.080-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:17:25.083-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:17:25.085-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:17:25.176-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:17:25.176-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:17:25.902-0500 W NETWORK [conn738] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:17:25.906-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:17:25.910-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:17:35.223-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:17:35.228-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:17:35.230-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:17:35.317-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:17:35.317-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:17:45.353-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:17:45.356-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:17:45.358-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:17:45.455-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:17:45.455-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:17:47.950-0500 W NETWORK [conn738] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:17:47.956-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:17:47.960-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:17:53.727-0500 W NETWORK [conn738] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:17:53.734-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:17:53.738-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:17:55.473-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:17:55.476-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:17:55.479-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:17:55.569-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:17:55.569-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:17:57.790-0500 W NETWORK [conn738] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:17:57.795-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:17:57.799-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:18:00.074-0500 W NETWORK [conn738] db exception when initializing on TT-RS19:TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS19/tdb-a19.white.xxx.com:4308,tdb-m19.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:18:00.078-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:18:00.083-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:18:04.132-0500 W NETWORK [conn738] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:18:04.136-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:18:04.141-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:18:05.608-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:18:05.611-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:18:05.612-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:18:05.708-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:18:05.708-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:18:15.733-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:18:15.737-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:18:15.739-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:18:15.841-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:18:15.842-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:18:25.880-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:18:25.890-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:18:25.897-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:18:26.009-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:18:26.010-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:18:26.533-0500 W NETWORK [conn727] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:18:26.537-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:18:26.541-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:18:29.175-0500 W NETWORK [conn727] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:18:29.184-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:18:29.194-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:18:36.029-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:18:36.033-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:18:36.035-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:18:36.132-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:18:36.132-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:18:46.201-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:18:46.205-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:18:46.206-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:18:46.298-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:18:46.299-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:18:56.354-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:18:56.358-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:18:56.360-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:18:56.465-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:18:56.465-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:19:06.510-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:19:06.513-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:19:06.515-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:19:06.608-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:19:06.608-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:19:13.991-0500 W NETWORK [conn727] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:19:13.996-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:19:14.004-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:19:16.651-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:19:16.655-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:19:16.657-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:19:16.759-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:19:16.759-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:19:17.351-0500 W NETWORK [conn727] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:19:17.354-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:19:17.358-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:19:26.800-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:19:26.804-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:19:26.805-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:19:26.901-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:19:26.901-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:19:36.962-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:19:36.965-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:19:36.966-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:19:37.051-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:19:37.051-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:19:47.087-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:19:47.091-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:19:47.093-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:19:47.185-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:19:47.185-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:19:57.296-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:19:57.300-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:19:57.302-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:19:57.390-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:19:57.390-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:20:07.432-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:20:07.437-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:20:07.440-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:20:07.549-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:20:07.549-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:20:17.591-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:20:17.595-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:20:17.597-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:20:17.686-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:20:17.686-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:20:27.728-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:20:27.733-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:20:27.735-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:20:27.832-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:20:27.833-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:20:37.931-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:20:37.935-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:20:37.938-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:20:38.021-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:20:38.021-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:20:48.063-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:20:48.067-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:20:48.068-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:20:48.155-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:20:48.155-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:20:58.190-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:20:58.195-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:20:58.197-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:20:58.286-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:20:58.286-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:20:58.756-0500 W NETWORK [conn727] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:20:58.760-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:20:58.764-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:20:58.941-0500 W NETWORK [conn727] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:20:58.946-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:20:58.952-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:20:59.682-0500 W NETWORK [conn727] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:20:59.686-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:20:59.693-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:21:08.319-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:21:08.323-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:21:08.325-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:21:08.407-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:21:08.407-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:21:15.609-0500 W NETWORK [conn727] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:21:15.613-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:21:15.617-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:21:16.247-0500 W NETWORK [conn727] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:21:16.251-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:21:16.256-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:21:16.559-0500 W NETWORK [conn727] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:21:16.570-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:21:16.580-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:21:18.439-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:21:18.443-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:21:18.445-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:21:18.543-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:21:18.543-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:21:26.865-0500 W NETWORK [conn727] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:21:26.870-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:21:26.875-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:21:28.583-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:21:28.586-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:21:28.588-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:21:28.689-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:21:28.690-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:21:34.814-0500 W NETWORK [conn727] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:21:34.817-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:21:34.821-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:21:38.813-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:21:38.816-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:21:38.818-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:21:38.909-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:21:38.909-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:21:48.939-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:21:48.943-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:21:48.945-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:21:49.037-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:21:49.038-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:21:51.536-0500 W NETWORK [conn727] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:21:51.540-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:21:51.544-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:21:59.071-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:21:59.075-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:21:59.077-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:21:59.175-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:21:59.175-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:22:09.206-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:22:09.210-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:22:09.212-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:22:09.306-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:22:09.306-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:22:16.784-0500 W NETWORK [conn727] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:22:16.789-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:22:16.795-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:22:19.344-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:22:19.348-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:22:19.351-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:22:19.466-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:22:19.467-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:22:20.279-0500 W NETWORK [conn727] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:22:20.284-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:22:20.288-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:22:29.498-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:22:29.502-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:22:29.507-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:22:29.617-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:22:29.617-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:22:39.656-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:22:39.661-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:22:39.663-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:22:39.787-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:22:39.788-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:22:48.856-0500 W NETWORK [conn727] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:22:48.860-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:22:48.864-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:22:49.819-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:22:49.822-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:22:49.825-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:22:49.910-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:22:49.910-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:22:59.940-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:22:59.943-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:22:59.945-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:23:00.027-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:23:00.028-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:23:10.066-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:23:10.070-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:23:10.072-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:23:10.184-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:23:10.184-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:23:11.355-0500 W NETWORK [conn727] db exception when initializing on TT-RS15:TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS15/tdb-a15.white.xxx.com:4308,tdb-m15.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:23:11.360-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:23:11.369-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:23:20.087-0500 W NETWORK [conn727] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:23:20.091-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:23:20.095-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:23:20.235-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:23:20.239-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:23:20.240-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:23:20.332-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:23:20.332-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:23:23.243-0500 W NETWORK [conn727] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:23:23.247-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:23:23.252-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:23:30.399-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:23:30.403-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:23:30.406-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:23:30.496-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:23:30.496-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:23:37.294-0500 W NETWORK [conn727] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:23:37.300-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:23:37.305-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:23:40.537-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:23:40.542-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:23:40.544-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:23:40.643-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:23:40.643-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:23:47.409-0500 W NETWORK [conn727] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:23:47.413-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:23:47.417-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:23:50.748-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:23:50.752-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:23:50.755-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:23:50.841-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:23:50.842-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:24:00.871-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:24:00.876-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:24:00.878-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:24:00.983-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:24:00.983-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:24:08.129-0500 W NETWORK [conn727] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:24:08.134-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:24:08.138-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:24:11.021-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:24:11.025-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:24:11.028-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:24:11.113-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:24:11.113-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:24:15.489-0500 W NETWORK [conn727] db exception when initializing on TT-RS17:TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS17/tdb-a17.white.xxx.com:4308,tdb-m17.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:24:15.492-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:24:15.496-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:24:21.151-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:24:21.154-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:24:21.156-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:24:21.239-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:24:21.239-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:24:31.271-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:24:31.286-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:24:31.288-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:24:31.426-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:24:31.426-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:24:31.986-0500 W NETWORK [conn727] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:24:31.990-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:24:31.994-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:24:41.546-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:24:41.550-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:24:41.552-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:24:41.637-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:24:41.638-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:24:51.673-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:24:51.676-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:24:51.678-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:24:51.765-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:24:51.765-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:24:59.024-0500 W NETWORK [conn727] db exception when initializing on TT-RS14:TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS14/tdb-a14.white.xxx.com:4308,tdb-m14.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:24:59.028-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:24:59.039-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:25:01.799-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:25:01.803-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:25:01.805-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:25:01.916-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:25:01.917-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:25:05.661-0500 W NETWORK [conn727] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:25:05.669-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:25:05.679-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:25:06.659-0500 W NETWORK [conn727] db exception when initializing on TT-RS16:TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS16/tdb-a16.white.xxx.com:4308,tdb-m16.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:25:06.664-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:25:06.673-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:25:07.866-0500 W NETWORK [conn727] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:25:07.871-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:25:07.880-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:25:11.946-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:25:11.950-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:25:11.952-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:25:12.045-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:25:12.045-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:25:20.339-0500 W NETWORK [conn727] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:25:20.345-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:25:20.354-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:25:22.082-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:25:22.086-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:25:22.088-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:25:22.196-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:25:22.196-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:25:23.749-0500 W NETWORK [conn727] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:25:23.753-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:25:23.757-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:25:32.235-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:25:32.238-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:25:32.241-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:25:32.335-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:25:32.335-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:25:42.365-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:25:42.370-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:25:42.372-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:25:42.473-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:25:42.473-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:25:44.874-0500 I NETWORK [conn738] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:25:44.875-0500 W NETWORK [conn727] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:25:44.878-0500 I NETWORK [conn738] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:25:44.879-0500 I - [conn727] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:25:44.881-0500 I NETWORK [conn738] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T02:25:44.883-0500 I CONTROL [conn727] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:25:44.982-0500 W NETWORK [conn738] db exception when initializing on TT-RS20:TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS20/tdb-a20.white.xxx.com:4308,tdb-m20.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:25:44.986-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:25:44.990-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:25:45.195-0500 W NETWORK [conn738] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:25:45.199-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:25:45.204-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:25:47.842-0500 W NETWORK [conn738] db exception when initializing on TT-RS18:TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS18/tdb-a18.white.xxx.com:4308,tdb-m18.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:25:47.846-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:25:47.850-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:25:48.026-0500 W NETWORK [conn738] db exception when initializing on TT-RS21:TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS21/tdb-a41.white.xxx.com:4308,tdb-m21.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:25:48.030-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:25:48.039-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:25:52.493-0500 I NETWORK [Balancer] scoped connection to tconfigdb-m02.db.xxx.com:4307,tconfigdb-d01.db.xxx.com:4307,tconfigdb-m01.db.xxx.com:4307 not being returned to the pool 2017-02-03T02:25:52.493-0500 I SHARDING [Balancer] caught exception while doing balance: Empty host component parsing HostAndPort from "" 2017-02-03T02:25:54.312-0500 W NETWORK [conn738] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:25:54.316-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:25:54.320-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:25:55.131-0500 W NETWORK [conn738] db exception when initializing on TT-RS22:TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308, current connection state is { state: { conn: "TT-RS22/tdb-a42.white.xxx.com:4308,tdb-m22.white.xxx.com:4308", vinfo: "historyDb.History @ 3285|25||55c0dbaf5b591f0b0cfcee5f", cursor: "(none)", count: 0, done: false }, retryNext: false, init: false, finish: false, errored: false } :: caused by :: 9 Empty host component parsing HostAndPort from "" 2017-02-03T02:25:55.136-0500 I - [conn738] Assertion failure _name.size() src/mongo/s/shard.h 88 2017-02-03T02:25:55.140-0500 I CONTROL [conn738] 0xa980a2 0xa3a8a9 0xa1e22a 0x96a831 0x9e0ed1 0x8ff15d 0x9005cd 0x908eb3 0x99de61 0x9200b7 0x9b09cc 0x99d40d 0x5e475a 0xa46f49 0x3326607aa1 0x33262e8aad ----- BEGIN BACKTRACE ----- {"backtrace":[{"b":"400000","o":"6980A2","s":"_ZN5mongo15printStackTraceERSo"},{"b":"400000","o":"63A8A9","s":"_ZN5mongo10logContextEPKc"},{"b":"400000","o":"61E22A","s":"_ZN5mongo12verifyFailedEPKcS1_j"},{"b":"400000","o":"56A831","s":"_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE"},{"b":"400000","o":"5E0ED1","s":"_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE"},{"b":"400000","o":"4FF15D","s":"_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"5005CD","s":"_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE"},{"b":"400000","o":"508EB3","s":"_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb"},{"b":"400000","o":"59DE61","s":"_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb"},{"b":"400000","o":"5200B7","s":"_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi"},{"b":"400000","o":"5B09CC","s":"_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE"},{"b":"400000","o":"59D40D","s":"_ZN5mongo7Request7processEi"},{"b":"400000","o":"1E475A","s":"_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE"},{"b":"400000","o":"646F49","s":"_ZN5mongo17PortMessageServer17handleIncomingMsgEPv"},{"b":"3326600000","o":"7AA1"},{"b":"3326200000","o":"E8AAD","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.0.14", "gitVersion" : "08352afcca24bfc145240a0fac9d28b978ab77f3", "uname" : { "sysname" : "Linux", "release" : "2.6.32-642.13.1.el6.x86_64", "version" : "#1 SMP Wed Jan 11 20:56:24 UTC 2017", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "E2E4D3C2B1703CEF484CCFE185BDA8AB474CCF52" }, { "b" : "7FFEC626E000", "elfType" : 3, "buildId" : "B7D50C2161B6674BD26DB5BA69B12A619488BBC5" }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3, "buildId" : "B3BD4C596D72FCBE4607C86FEEC14F47B46D0DCC" }, { "path" : "/usr/lib64/libssl.so.10", "elfType" : 3, "buildId" : "7CE5058BE3F2AE6EBC0DF61E790C3FCED1A34C7B" }, { "path" : "/usr/lib64/libcrypto.so.10", "elfType" : 3, "buildId" : "096F60DC43484ECA364206125CED7D563FF9D027" }, { "path" : "/lib64/librt.so.1", "elfType" : 3, "buildId" : "86FE5BC1F46B8F8AA9A7A479FF991900DB93F720" }, { "path" : "/lib64/libdl.so.2", "elfType" : 3, "buildId" : "045D39F19533291EBD72D0EE0247F9D49BE2521E" }, { "path" : "/lib64/libm.so.6", "elfType" : 3, "buildId" : "B60EF3FCE5D4D2D8BAD2585D5CAAA1167B35DBFD" }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3, "buildId" : "9A6E4BDFA184364D81F7DFD789474C3FB8F98A00" }, { "path" : "/lib64/libc.so.6", "elfType" : 3, "buildId" : "F14F3F5B55FC325FDFA7FB6F22F73CA1C6977379" }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "DB04BDF55FE66BADD1081D833C17B4881E0EEDB9" }, { "path" : "/lib64/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "9B852585C66329AA02EFB28497E652A40F538E78" }, { "path" : "/lib64/libkrb5.so.3", "elfType" : 3, "buildId" : "EF3AACAFD6BF71BB861F194C1559153FB0B020E2" }, { "path" : "/lib64/libcom_err.so.2", "elfType" : 3, "buildId" : "152E2C18A7A2145021A8A879A01A82EE134E3946" }, { "path" : "/lib64/libk5crypto.so.3", "elfType" : 3, "buildId" : "DDE6774979156442185836150FC0785170F8001F" }, { "path" : "/lib64/libz.so.1", "elfType" : 3, "buildId" : "5FA8E5038EC04A774AF72A9BB62DC86E1049C4D6" }, { "path" : "/lib64/libkrb5support.so.0", "elfType" : 3, "buildId" : "A23DAFBCE170763BF1E836A8B26113F9CD20E0DA" }, { "path" : "/lib64/libkeyutils.so.1", "elfType" : 3, "buildId" : "AF374BAFB7F5B139A0B431D3F06D82014AFF3251" }, { "path" : "/lib64/libresolv.so.2", "elfType" : 3, "buildId" : "DDF6449707FD4C49DDE32A293EEE9AC218BFC460" }, { "path" : "/lib64/libselinux.so.1", "elfType" : 3, "buildId" : "B4576BE308DDCF7BC31F7304E4734C3D846D0236" } ] }} mongos(_ZN5mongo15printStackTraceERSo+0x32) [0xa980a2] mongos(_ZN5mongo10logContextEPKc+0xE9) [0xa3a8a9] mongos(_ZN5mongo12verifyFailedEPKcS1_j+0xDA) [0xa1e22a] mongos(_ZNK5mongo21DBClientShardResolver15chooseWriteHostERKSsPNS_16ConnectionStringE+0x4B1) [0x96a831] mongos(_ZN5mongo14BatchWriteExec12executeBatchERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseEPNS_19BatchWriteExecStatsE+0x351) [0x9e0ed1] mongos(_ZN5mongo13ClusterWriter10shardWriteERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x30D) [0x8ff15d] mongos(_ZN5mongo13ClusterWriter5writeERKNS_21BatchedCommandRequestEPNS_22BatchedCommandResponseE+0x5FD) [0x9005cd] mongos(_ZN5mongo15ClusterWriteCmd3runEPNS_16OperationContextERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x2C3) [0x908eb3] mongos(_ZN5mongo7Command22execCommandClientBasicEPNS_16OperationContextEPS0_RNS_11ClientBasicEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x311) [0x99de61] mongos(_ZN5mongo7Command20runAgainstRegisteredEPKcRNS_7BSONObjERNS_14BSONObjBuilderEi+0x227) [0x9200b7] mongos(_ZN5mongo8Strategy15clientCommandOpERNS_7RequestE+0x1DC) [0x9b09cc] mongos(_ZN5mongo7Request7processEi+0x60D) [0x99d40d] mongos(_ZN5mongo21ShardedMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x5A) [0x5e475a] mongos(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x339) [0xa46f49] libpthread.so.0(+0x7AA1) [0x3326607aa1] libc.so.6(clone+0x6D) [0x33262e8aad] ----- END BACKTRACE ----- 2017-02-03T02:26:02.669-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T02:26:02.673-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T02:26:02.675-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307] 2017-02-03T07:44:33.269-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m02.db.xxx.com:4307] 2017-02-03T07:44:33.272-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-d01.db.xxx.com:4307] 2017-02-03T07:44:33.274-0500 I NETWORK [Balancer] SyncClusterConnection connecting to [tconfigdb-m01.db.xxx.com:4307]